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SYSTEMS AND METHODS FOR MULTIPLE-FILE DATA COMPRESSION 

Held of the Invention 

This invention relates to the field of data compression. In particular, it relates to systems and methods of 
organizing multiple files to be compressed into one archive file, and systems and methods of compressing the multiple files 
5 as one unified file. 

Background 

A number of compression methods have been utilized to reduce the size of an input data file by encoding symbols 
or strings of symbols as numeric codes or combinations of numeric codes and symbols. Such encoding reduces repetitions 
of symbols in the input data file. Major categories of compression methods include dictionary methods and statistical 
10 methods. Dictionary methods encode strings of symbols as tokens using a dictionary. A token indicates the location of the 
string in the dictionary. Dictionary methods include LZ77, LZ78, LZSS, and LZW. Statistical methods use codes of variable 
lengths to represent symbols or groups of symbols, with the shorter codes representing symbols or groups of symbols that 
appear or are likely to appear more often. Statistical methods include the Huffman method and the dynamic Huffman 
method. 

15 The LZ77 method reads part of the input data into a window. The window is divided into a search buffer (i.e., a 

dictionary) on the left and a look-ahead buffer on the right. The search buffer is the current dictionary that includes 
symbols that have been read and encoded. The look-ahead buffer includes data yet to be encoded. The encoder scans the 
search buffer from right to left looking for a match to the longest stream of symbols in the look-ahead buffer. When the 
longest match is found, the matched stream of symbols plus the next symbol in the look-ahead buffer are encoded as a 

20 token containing three parts, the position (i.e., the distance from the end of the search buffer), the length of the longest 
match, and the next symbol For a more detailed description of the LZ77 method please refer to pages 154-157 of Data 
Compression the Complete Reference by David Salomon, Second Edition, 2000. The LZ78 method is a variation of LZ77. 
For a more detailed description of the LZ78 method please refer to pages 164-168 of Data Compression the Complete 
Reference by David Salomon, Second Edition, 2000. 

25 The LZSS method is a variation of LZ77. Unlike the LZ77 tokens, LZSS tokens use two fields instead of three. An 

LZSS token includes a position and a length. If no match is found, the uncompressed code of the next symbol is produced 
as output, with a flag bit to indicate it is uncompressed. The LZSS method also holds the look-ahead buffer in a circular 
queue and the search buffer in a binary search tree. For a more detailed description of the LZSS method please refer to 
pages 158-161 of Data Compression the Complete Reference by David Salomon, Second Edition, 2000. 

30 The LZW method is a variation of LZ78. For a detailed description of the LZW method please refer to U.S. Patent 

No. 4,558,302 issued on December 1 0, 1 985. 
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The Huffman method, also called the static Huffman method, builds a list of all of the symbols in descending 
order according to their probabilities of appearance. The method builds a tree from the bottom up with each leaf 
representing a symbol. The two symbols with the smallest probabilities of appearance are added to the top of the tree and 
deleted from the list. An auxiliary symbol is created to represent these two symbols. This process is repeated until the list 
S is reduced to one auxiliary symbol. The method then assigns codes of variable length to the symbols on the tree. One 
variation of the Huffman method is the dynamic, or adaptive, Huffman method. This method assumes that the probabilities 
of appearance are not known prior to reading the input data. The compression process starts with an empty tree and 
modifies the tree as symbols are being read and compressed. The decompression process works in synchronization with the 
compression process. For a more detailed description of the Huffman method and the dynamic Huffman method please refer 

10 to pages 62-82 of Data Compression the Complete Reference by David Salomon, Second Edition, 2000. 

Context based methods are another type of compression methods. Context based methods use one or more 
preceding symbols to predict (i.e., to assign the probability of) the appearance of the next symbol. For example, in English, 
the letter V is almost always followed by the letter V. When letter V appears, a context based method would assign a 
high probability of appearance to the letter V. One example of a context based method is the Markov model which may be 

15 classified by the number of proceeding symbols it uses to predict the next symbol. An Order-N Markov model uses the N 
preceding symbols to predict the next symbol. For a more detailed description of the Markov model, please refer to page 
1 26 and pages 726 - 735 of Data Compression the Complete Reference by David Salomon, Second Edition 2000. 

Compression methods may be used by programs to compress multiple files to archives. For example, the ARC 
program compresses multiple files and combines them into one file called an archive. PKZIP is a variation of ARC. ZIP is an 

20 open standard created by the maker of PKZIP for compressing files to archives. For details of ARC and PKZIP please refer 
to pages 206-211 of Data Compression the Complete Reference by David Salomon, Second Edition, 2000. Other 
compression/archiving programs include ARJ by Robert K. Jung, LHArc by Haruyasu Yoshizaki, and LHZ by Haruhiko 
Okumura and Haruyasu Yoshizaki. 

Summary of the Invention 

25 The systems and methods relate to the compression of multiple files into a single file called an archive. The 

systems and methods examine the multiple files to determine their data characteristics. The systems and methods then 
arrange the order of the multiple files according to their data characteristics to increase the potential of data redundancy 
among neighboring files. The increased potential of redundancy provides potential improvement in compression ratio and 
compression speed. The ordered multiple files qre then combined as one unified file and compressed. 

30 One embodiment uses a dictionary method to compress the unified file. In addition, a large dictionary is used in 

one embodiment to take advantage of potential between-file redundancies. In another embodiment, the redundancy 
characteristics of the multiple files are examined to dynamically determine the dictionary size. After the dictionary 
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compression method produces an intermediary output data file, the intermediary output data may be separated into multiple 
sections, such that for each section a compression method that is potentially suitable for the data characteristics of that 
section is applied. The compressed result of each section are then combined to produce the final output. 

One embodiment of the present invention is a method of compressing a plurality of files. The method comprises 
5 examining said plurality of files to determine data characteristics that correspond to said plurality of files and determining 
ranking orders for said plurality of files according to said data characteristics. In addition, the method comprises combining 
said plurality of files into a unified file at least according to said ranking orders and compressing said unified file. 

An additional embodiment of the present invention is a system for compressing a plurality of files. The system 
comprises an examination module configured to examine said plurality of files to determine data characteristics that 
1 0 correspond to said plurality of files and an ordering module configured to determine ranking orders for said plurality of files. 
In addition, the system comprises a combining module configured to combine said plurality of fifes as a unified file at least 
according to the ranking orders of said plurality of files and a compressing module configured to compress said unified file 
using a first compression method. 

A further embodiment of the present invention is a system for compressing a plurality of files. The system 
15 comprises means for examining said plurality of files to determine data characteristics that correspond to said plurality of 
files and means for determining ranking orders for said plurality of files. In addition, the system comprises means for 
combining said plurality of files as a unified file at least according to the ranking orders of said plurality of files and means 
for compressing said unified fDe using a first compression method. 

For purposes of summarizing the invention, tertain aspects, advantages, and novel features of the invention are 
20 described herein. It is to be understood that not necessarily all such advantages may be achieved in accordance with any 
particular embodiment of the invention. Those skilled in the art will recognize that the invention may be embodied or 
carried out in a manner that achieves one advantage or a group of advantages as taught herein without necessarily 
achieving other advantages as may be taught or suggested herein. 

These and other features will now be described with reference to the drawings summarized below. These 
25 drawings and the associated description are provided to illustrate embodiments of the invention, and not to limit the scope 
of the invention. Throughout the drawings, reference numbers are re-used to indicate correspondence between referenced 
elements. In addition, the first digit of each reference number indicates the figure in which the element first appears. 

Brief Description of the Drawings 
FIGURE 1 illustrates a high-level block diagram for one embodiment of a multiple-file compression system. 
30 FlfiURE 2 illustrates one embodiment of an example original file list and one embodiment of an example sorted file 

fist. 
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FIGURE 3 illustrates one embodiment of a unified input data file, one embodiment of an intermediary output file, 
and one embodiment of a final output file. 

FIGURE 4 illustrates a flowchart of one embodiment of a first-stage compression process. 
FIGURE 5 illustrates a flowchart of one embodiment of a second-stage compression process. 
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Detailed Description 
I OVERVIEW 

The present invention relates to the compression of multiple files into a single file called an archive. The data 
characteristics of the multiple files are examined to determine the order in which the files are ranked in a sorted file list. 
5 The files are then combined into a single unified file according to the order of the sorted file list and compressed. The 
ordering of the files increases the potential of repetition among neighboring files and provides potential improvement in 
compression ratio and compression speed. In one embodiment the compressed results are compressed a second time. 

One embodiment of the systems ami methods compresses the ordered files using a dictionary method and utilizing 
a large dictionary. Such a large dictionary not only has the potential to improve the compression ratio of files with high 
10 degree of redundancy within a file, but also has the potential to improve the compression ratio of neighboring files that are 
somewhat redundant with each other. Because similar files have been placed next to each other in the sorted file list a 
large dictionary is likely to take advantage of between-file redundancy to improve the compression ratio of the files. 
Another embodiment examines the redundancy characteristics of the multiple files to dynamically determine the dictionary 
size. 

15 In further compressing the intermediary output data already compressed by a dictionary method, one embodiment 

separates the intermediary output data into multiple sections based on the characteristics of the intermediary output data. 

The data within each section may have redundancy. Each section of the intermediary output data is compressed using a 

method that is potentially suitable for compressing data with such characteristics. The compressed results are then 

combined with header information to form the final output data. 
20 ||. MULTIPLE-FILE COMPRESSION SYSTEM 

FIGURE 1 illustrates a high-level block diagram of a multiple-file compression system 102. The system 102 

includes an examination module 104, an ordering module 106, a combining module 108 and a compressing module 110. 

One embodiment of the compressing module 110 also includes a first compressing sub-module 112 and a second 

compressing sub-module 114. 

25 As used herein, the word module, whether in upper or lower case letters, refers to logic embodied in hardware or 

firmware, or to a collection of software instructions, possibly having entry and exit points, written in a programming 
language, such as, for example, C++. A software module may be compiled and linked into an executable program, 
installed in a dynamic link library, or may be written in an interpretive language such as BASIC. It will be appreciated that 
software modules may be callable from other modules or from themselves, and/or may be invoked in response to detected 

30 events or interrupts. Software instructions may be embedded in firmware, such as an EPROM. It will be further 
appreciated that hardware modules may be comprised of connected logic units, such as gates and flip-flops, andjor may be 
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comprised of programmable units, such as programmable gate arrays or processors. The modules described herein are 
preferably implemented as software modules, but may be represented in hardware or firmware. 

It should be obvious to those skilled in the art that the modules described in the application may be integrated into 
fewer modules. One module may also be separated into multiple modules. It should also be obvious to those skilled in the 
5 art that the described modules can be implemented as hardware, software, firmware or any combinations of. The described 
modules may reside at different locations connected through a wired or wireless network. 
A. Examination Module 

The examination module 104 prompts a user to identify an original file list 202. An example of the original file list 
202 is illustrated in FIGURE 2 and will be discussed further below. Referring back to FIGURE 1, the examination module 

10 104 examines the files in the original file Gst 202 to determine the data characteristics of each file. The examination may 
include reading all or part of each file, reading attribute/properties information of each file, reading the size, location, name 
and/or extension of each file, as well as a combination of the above. In one embodiment, the examination module 104 
examines the appearance frequencies of *a-Z" alphabets. In another embodiment, the examination module 104 examines 
the appearance frequencies of numbers. 

15 B. Ordering Module 

The ordering module 106 orders files of the original file list 202 into a sorted file list 202. An example of the 
sorted file list 204 is illustrated in FIGURE 2 and discussed further below. Referring back to FIGURE 1, files in the sorted 
file list 204 are ordered according to their data characteristics examined by the examination module 104. Files with similar 
data characteristics are placed next to each other. The examination module 104 may examine multiple data characteristics 

20 of each file, and the ordering module 106 may determine the ordering of the files according to some or all of their multiple 
data characteristics. For example, files may be sorted by file extension first and then by file name. For another example, 
files may be sorted by file extension first and then by file size. In one embodiment, the ordering module 106 automatically 
orders files in the sorted file list. In another embodiment, the ordering module 106 acts as a wizard and provides a user 
with help information to assist the user in determining the order of the files. Help information may include, for example, the 

25 data characteristics of the files. 

In addition to using the sorted file list 204, other embodiments may also be used to record the order of files of the 
original file list 202. For example, each file of the original file list 202 may be assigned an order number indicating the order 
in which it would be combined by the combining module 108. 
C. Combining Module 

30 The combining module 108 combines the files successively according to the order in the sorted file list 204, to 

form a unified input data file 302. An example of the unified input data file 302 is illustrated in FIGURE 3 and is discussed 
further below. Referring back to FIGURE 1, the combining module 108 removes the "End-of-File" 0.e., TOFT marker from 



WO 01/50612 PCT/US01/00424 



each file except for the last file in the sorted file list 204. In one embodiment the combining module 108 also creates an 
archive header portion 304 and a file header portion 306. 
D. Compressing Module 

The compressing module 1 10 applies a first compression method to the unified input data file 302 produced by 
5 the combining module 1 08. In one embodiment, the compressing module 1 1 0 applies a dictionary method. The compressing 
module 110 examines the files in the sorted file list 204 and determines a dictionary size that is likely to be optimal with 
the redundancy characteristics of the files in the sorted file list 204. In one embodiment the determination of the 
dictionary size is made by the examination module 104. The determination of the dictionary size may also be made by the 
ordering module 106 or by the user. In one embodiment, the compressing module 110 also compresses the file header 
10 portion 306 to produce a compressed file header portion 324. The compressing module 110 combines the archive header 
304, the compressed file header portion 324 and the compressed result of the unified input data file 302 to produce the 
final output file 322. 

In one embodiment, the compressing module 110 applies a second compression method to the intermediary 
output file 312 produced by the first compression method. In one embodiment the compressing module 110 separates the 

15 intermediary output file 312 into multiple sections and compresses the data in one or more of the sections, the 
compressing module 110 then combines the compressed or uncompressed results of all the sections to form the final 
compressed data portion 326. The compressing module 110 combines the final compressed data portion 326, the archive 
header portion 304, and the file header portion 306 or the compressed file header portion 324 to form the final output file 
322. In one embodiment, a recovery information portion 328 is also appended to the final output file 322. An example of 

20 the final output file 322 is illustrated in FIGURE 3 and is further discussed below. 

One embodiment of the compressing module 110 includes a first compressing sub-module 112 and a second 
compressing sub-module 1 14. The first compressing sub-module 1 12 is configured to apply a first compression method to 
the unified input data file 302. The second compressing sub-module 1 14 is configured to apply a second compression 
method to the intermediary output file 31 2 produced by the first compression method. 

25 In one embodiment, the compressing module 110 combines the final output file 322 with a ZIP archive header 

334, a ZIP central directory header 336, and a ZIP end of central directory header 338 to form a ZIP-recognized output file 
332. The ZIP-recognized output file 332 may be recognized by any utility program that supports the ZIP file format. Details 
of the ZIP headers are described below in the section titled 111. FILE FORMATS." 
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III. FILE FORMATS 

FIGURE 2 illustrates an example of an original file fist 202 and an example of a sorted file list 204. In this 
example, the original file list 202 of six files is sorted to produce the sorted file Est 204 of the same six files in the same or 
a different order. 

5 FIGURE 3 illustrates an embodiment of a unified input data file 302, an embodiment of an intermediary output file 

312, and an embodiment of a final output file 322. FIGURE 3 also illustrates an embodiment of an archive header portion 
304, an embodiment of a file header portion 306, and an embodiment of a ZIP-recognized output file 332. The exemplary 
unified input data file 302 is formed by combining all the files in the sorted file list 304. The exemplary intermediary output 
file 312 includes the compressed result of the unified input data file 302, produced by the first-stage compression process 
10 described below. 

The exemplary final output file 322 includes an archive header portion 304 that stores information about the 
archive, a compressed file header portion 324, a final compressed data portion 326, and a recovery information portion 
328. The compressed file header portion 324 includes the compressed result of the file header portion 306. The file header 
portion 306 includes header information about the files in the sorted file list 104, such as the name, location, size and the 

15 date and time of creation or modification of each file, and so forth. The final compressed data portion 326 includes the 
final compressed result of the intermediary output file 312. The recovery information portion 328 includes recovery 
information about the final compressed data portion 326. The recovery information may include the CRC (Cyclical 
Redundancy Check or Cyclical Redundancy Code) of the final compressed data portion 326, and in one embodiment, the 
recovery information portion 328 may be compressed. 

20 While FIGURE 3 illustrates embodiments of a unified input data file 302, an intermediary output file 312, and a 

final output file 322, it is recognized that other embodiments may be used. For example, one embodiment of the final 
output file 322 may not include a recovery information portion 328. 

In one embodiment, a ZIP archive header 334, a ZIP central directory header 336 and a ZIP end of central 
directory header 338 are combined with the final output file 322 to form a ZIP-recognized output file 332. The formats of 

25 the ZIP archive header 334, the ZIP central directory header 336 and the ZIP end of central directory header 338 are 
maintained as open standards by PKWARE, Inc. located in Brown Deer, Wis. (web site www.pkware.com) The ZIP- 
recognized output file 332 conforms to the current ZIP file format and can therefore be recognized by any utility program 
that supports the current ZIP file format. 

IV. MULTIPLE FILE COMPRESSION PROCESSES 

30 In one embodiment, the multiple file compression process includes a first-stage compression process and a 

second-stage compression process. 
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A. First-Stage Compression 

1. Prompt For Original File List 

FIGURE 4 illustrates one embodiment of a first-stage compression process. Beginning at start state block 400, 
the first-stage compression process proceeds to block 402 and prompts a user for an original file Est 202, which lists the 
5 files to be compressed. 

2. Create Sorted File List 

At block 404, the first-stage compression process converts the original file list 202 into a sorted file list 204 to 
increase the potential of redundancy among neighboring files in thB sorted file list 204. In one embodiment the original file 
list 202 is sorted by file extension. For example, files that share the ".doc* extension (i.e., word processing document files) 

10 are placed together and files that share the ".cpp" extension (i.e., C++ source code files) are placed together. Because 
files with the same extension are likely to share more redundancy than files with different extensions, conversion from the 
original file list 202 into a sorted file list 204 is likely to improve the compression ratio and speed for the first-stage 
compression. In one embodiment the original file list 202 is sorted by a combination of file extension and file name. The 
sorting by file name may further improve the redundancy among neighboring files, such as, for example if some neighboring 

15 files are backup versions of the same master file. In another embodiment, the original file list 202 is sorted by a 
combination of file extension and file size. For example, files are first sorted by extension, and files of the same extension 
are then ordered by file size. 

In other embodiments, files with the same file type are placed close together in the sorted file list 204. For 
example, files with the ".doc" extension are placed next to files with the ".txt" extension because they are determined to 

20 have the same 'text document" file type. Files with the ".exe" extension are placed next to files with the ".dll" extension 
because they are determined to have the same "binary program" file type. Each file's file type may be determined by using 
its file extension to look for the corresponding file type in a file extension-file type matching table. The file extension-file 
type matching table may be created prior to block 402 to assign a file type for each file extension. 

In other embodiments, files of the same file group are placed close together in the sorted file list 204. File groups 

25 may include, for example, an alphabet-rich file group, a number-rich file group, an image data file group, an audio data file 
group, a video data file group, a high-redundancy file group, a low-redundancy file group, and so forth. Ordering files by file 
types and file groups may improve compression ratio and speed because files with the same file type or file group are likely 
to have more redundancy than other files. File characteristics such as file type and file group may be determined by reading 
the file extension of a file, reading all or part of a file, reading attribute (also called properties) information about a file, and 

30 so forth. Attribute and/or properties information about a file may be included in a header of the file. 

In another embodiment, black and white image files may be placed next to each other in the sorted file list 204 
and color image files may also be placed next to each other in the sorted file list 204. The color scheme of each image ffle 
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may be determined by reading the color scheme information from the image file header or by reading all or part of an image 
file. 

In additional embodiments, an artificial intelligence program, a heuristic program and/or a rule-based program 
may be used to determine the file orders in the sorted file list 204. For example, the first-stage compression process may 
5 read a part of each file in the original file list 202 to determine the data characteristics of each file, files with similar 
redundancy characteristics are placed close together in the sorted file list 204. Data characteristics may include the 
appearance frequency of the "a-Z" alphabet the appearance frequency of numbers, the appearance frequency of binary 
codes, and so forth. 

In some embodiments, the first-stage compression process automatically carries out the ordering process of block 
10 404. In other embodiments, a user arranges the ordering of files using help information provided by the first-stage 
compression process. The help information may include the file extension, file type, file group and other data 
characteristics of each file. Combinations of automatic ordering and manual ordering may also be used. For example, the 
first-stage compression process may carry out a preliminary ordering of the original file list 202 and may enable the user to 
adjust the preliminary orders to produce the sorted file list 204. 
15 In addition to using the sorted file list 204, other embodiments may also be used to record the order of files of the 

original file list 202. For example, each file of the original file list 202 may be assigned an order number indicating the order 
in which it would be combined at block 408. 
3. Create Headers 

Still referring to FIGURE 4, at block 406, the first-stage compression process creates an archive header portion 
20 304 and a file header portion 306. The archive header portion 304 includes information about the entire archive that is to 
be created. Such information may include the creation date and time of the archive, the archive's CRC (Cyclical 
Redundancy Check or Cyclical Redundancy Code), a flag indicating whether the archive is locked, a flag indicating whether 
the archive is damage protected and so forth. In one embodiment archive information in the archive header portion 304 
may be updated after the compressing of block 410. In another embodiment archive information in the archive header 
25 portion 304 may be updated after the second-stage compression illustrated in FIGURE 5 and discussed in further detail 
below. The file header portion 306 includes file header information for each file in the sorted file list 204. In one 
embodiment the file header information for a file may include the file name, the location of the file, the dates and times 
that the file was created and/or modified, file size prior to compression, and other attribute information about the file such 
as whether it is read-only. 
30 4. Combine Files 

At block 408 of FIGURE 2, the first-stage compression process appends all but the first file in the sorted file list 
204 successively to the first file in the sorted file list 204. During the appending process, the "End-of-File" (i.e., "EOFT 
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marker, if such a marker exists, is removed from each of the files within the sorted file fist 204, except the last file in the 
sorted file list 204. The data from all the files in the sorted file list 204 forms the unified input data file 302. It is 
recognized that the first-stage compression process may combine the files using a variety of methods, such as, for 
example, combining subsets of the set of files in parallel and then merging the combined files together. 
5. Compress the Combined File 

At block 410 of FIGURE 4, the first-stage compression process applies a compression method to the unified input 
data file 302. A dictionary method, such as the LZSS method, is used in one embodiment but other compression methods 
including other dictionary methods may also be applied. The dictionary size may be predetermined prior to the start of the 
first-stage compression process, or dynamically determined after the start of the first-stage compression process. The 
dictionary size may exceed a dictionary size unit number of fixed size, such as, for example, one kilobyte, one megabyte, ten 
megabytes, a hundred megabytes, one gigabyte, and so forth. As the dictionary size grows, the compression ratio may 
improve but dictionary search speed may decrease. This is because a string of symbols is more likely to find a match in a 
larger dictionary than in a smaller dictionary, but a large dictionary takes longer to search. 

In one embodiment, the first-stage compression process enables a user to specify a dictionary size for 
compression. This option permits a user to choose a dictionary size that is Dkely to be optimal with respect to the 
redundancy characteristics of the sorted file list 204. In another embodiment, the first-stage compression process 
examines the files of the sorted file fist 204 and determines a dictionary size that is likely to be optimal with respect to the 
redundancy characteristics of the sorted file list 204. In yet another embodiment, the first-stage compression process 
provides a user with help information, such as the redundancy characteristics, and assists a user to set the dictionary size. 

To determine the redundancy characteristics of the sorted file Hst 204, the first-stage compression process 
examines information of the sorted file list 204, such as the total size of all f iles, the size of each file, how many files share 
the same file group, how many files share the same file type, how many files share the same ffle name, how many files 
have similar file names, the number of different file groups and different file types, and so forth. For example, if several 
files have the same file extension, very similar file names, and very similar file sizes, then these several files may be back- 
up versions of the same master file. Therefore, the dictionary size may be set at sufficiently more than the file size of each 
of the several files to take advantage of the high degree of redundancy. 

In one example, the first file is read into the dictionary, (because the dictionary size is large enough to allow the 
entire first file to be read into the dictionary), the rest of the several files may each be encoded as one token with a length 
dose to the size of the first file, plus a few other tokens and/or uncompressed symbols. In another example, a large part of 
the first file is read into the dictionary. In yet another example, if the file size of every file in the sorted file list 204 is small 
and very few files share the same file group or file type, thereby indicating a low degree of between-file redundancy, then 
the dictionary size may be set at a relatively small size so that the speed of searching the dictionary improves. 
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In one embodiment, the dictionary size is initially set to a default dictionary size. The dictionary size is then 
increased if certain increment-triggering events are encountered during the examination of each file in the sorted file Dst 
204. These events may include, for example, finding two files of the same file name and extension, finding two files of the 
same file extension, finding two files of the same file type, finding two files of the same file group, and so forth. Each time 
5 one of such increment-triggering events is encountered, the dictionary size is increased. Each of such increment-triggering 
events may be associated with the same or a different increment amount in dictionary size. Increment amount may be 
determined as percentages of the size of some or all of the files in the sorted file list 204, as percentages of the default 
dictionary size, as numbers of bytes, and so forth. 

In another embodiment the dictionary size is decreased if certain decrement-triggering events are encountered. In 
10 yet another embodiment, both increment-triggering events and decrement- triggering events may be used to adjust the 
dictionary size. The dictionary size may also be increased or decreased in proportion to the total size of files in the sorted 
file list 204 and the average file size. 

The examination of the redundancy characteristics and the determination of the dictionary size may also be made 
at block 404, at the time the first-stage compression process examines the files of the original file list 202 and creates the 
15 sorted file list 204. 

6. Intermediary Output File Is Formed 

After the dictionary size is set and a dictionary method is applied to the unified input data file 302, at block 412 
■. of FIGURE 4, the first-stage compression process forms the intermediary output file 312. One embodiment of the 
intermediary output ffle 312 includes two types of data: tokens of position/length pairs and uncompressed symbols. A 

20 token or an uncompressed symbol is accompanied by a one-bit 0/1 flag that indicates whether it is compressed or 
uncompressed. This embodiment of the intermediary output file 312 may be produced using LZSS or another dictionary 
method that produces uncompressed symbols and position/length pairs. After the intermediary output file 312 is produced, 
the first-stage compression process proceeds to an end state at block 414. 
E. Second-Stage Compression 

25 FIGURE 5 illustrates a flowchart of one embodiment of a second-stage compression process. The second-stage 

compression process begins with a start state at block 500 and proceeds to block 502. At block 502, the second-stage 
compression process compresses the file header portion 306 into the compressed file header portion 324. It should be 
understood that the first-stage compression process may also be used to compresses the file header portion 306. File 
header information may include, for example, text identifying the computer on which a file is located, the hard drive on 

30 which a file is located, the directory on which a file is located, and so forth. Because multiple files may be located on the 
same computer, the same hard drive or the same directory, the file header information may include identical sub-strings of 
substantial length. Hie header information may also include, for example, the date and time of file creation or modification, 
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and the file size. Hie header information for such data may also include redundant data. A compression method such as the 
Order- 1 Dynamic Markov model may be suitable for compressing the file header portion 306. The Order- 1 Dynamic Markov 
model uses one preceding symbol to predict (i.e., assign the probability of) the appearance of the next symbol, working 
dynamically by adjusting probabilities based on prior symbol pairing patterns in this section. 
5 At block 504, the intermediary output file 312 is separated into multiple intermediary output sections. In one 

embodiment, the intermediary output file 312 is separated into four intermediary output sections: a first section for the 1- 
brt flags, a second section for uncompressed symbols, a third section for position codes, and a fourth section for length 
codes. As described in the paragraphs above, in this embodiment, the intermediary output file 312 includes uncompressed 
symbols and tokens of position/length pairs that are accompanied by a 1-bit flag indicating whether it is compressed. Other 

10 embodiments of multiple sections may also be used. For example, one embodiment separates the intermediary output file 
312 into two sections, one section for uncompressed symbols and one section for the rest of the intermediary output data. 

The second-stage compression process then applies one or more compression methods tc the intermediary output - 
sections to take advantage of the data characteristics in each section. The compression of the sections may be carried out 
in sequence or in parallel. The following paragraphs suggest some compression methods that may be suitable for each of 

IS the sections, although other compression methods may also be used. In addition, it may also become desirable to not 
compress some sections. 

Still referring to FIGURE 5, at block 506, the second-stage compression process compresses the first section. The 
first section for the 1-bit flags is characterized by codes representing the binary 0/1 values. Because this section stores 
codes of binary values, a compression method such as the dynamic Huffman method or the RLE method may be suitable for 
20 compressing this section. The RLE (Run Length Encoding) method compresses data by replacing a string of identical 
symbols (called a run length) with one token. The token stores the symbol and a number representing the length of the run 
of identical symbols. 

At block 508, the second-stage compression process compresses the second section. The second section for 
uncompressed symbols is characterized by codes representing symbols with no match in the dictionary and are thus 

25 uncompressed. Codes representing the "a-z" letters, the "A-Z" letters, and the 0-9 numbers may appear frequently in this 
section. Therefore, a compression method such as a Pseudo-Contextual method may tie suitable for compressing this 
section. Using the Pseudo-Contextual method, each symbol is assigned to a group. Groups may include the "a-z' letter 
group, the 'A-Z" letter group, and the 0-9 number group. In one embodiment, uncompressed symbols are assigned to up to 
sixteen groups. A symbol is represented by a group flag and a distance code. The group flag indicates the group to which 

30 the symbol is assigned. A distance code indicates the distance between the symbol and the first symbol of the group. For 
example, a symbol "A 0 assigned to the "A-Z* group has a distance code of 0, a symbol "C" assigned to the same group has 
a distance code of 2. Therefore, a symbol "A" in the "A-Z" group and a symbol "0" in the 0-9 group share a distance code 
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of 0. Symbols "A" and "0' are therefore redundant to some degree. The Pseudo-Contextual method then compresses the 
group flag-distance code pairs. 

At block 510, the second-stage compression process compresses the third section. The third section for position 
codes is characterized by codes representing numbers. These numbers are typically small numbers and are typically less 
5 than an upper range such as one thousand or one million, depending on the dictionary size. Therefore, a compression 
method such as the dynamic Huffman method or the static Huffman method may be suitable for compressing this section. 

In one embodiment, the second-stage compression process separates the position codes into multiple sub-sections 
and compresses the multiple sub-sections. For example, in one embodiment, the second-stage compression process stores 
the first eight bits of each position code in a first sub-section, and stores the rest of the bits of each position code in a 
10 second sub-section. Compared with the original position codes, the data in the first sub-section represent smaller numbers 
and are likely to have smaller variations. Therefore, compressing the position codes as multiple sub-sections may achieve 
better compression ratio than compressing the position codes as one section. It should be understood that the fourth 
section for length codes may also be compressed as multiple sub-sections. 

At block 512, the second-stage compression process compresses the fourth section. The fourth section for length 
15 codes is characterized by codes representing numbers. These numbers are typically small numbers and are typically less 
than an upper range such as one hundred or one thousand depending on the dictionary size and the degree of redundancy. 
Therefore, a compression method such as the dynamic Huffman method or the static Huffman method may be suitable for 
compressing this section. 

Still referring to FIGURE 5, at block 514 the second-stage compression process combines the compressed results 
20 from blocks 506, 508, 510 and 512 to form the final compressed data portion 326. The second-stage compression process 
combines the final compressed data portion 326, the archive header portion 304 and the compressed file header portion 
324 to produce the final output file 322. In one embodiment, after the compressed file header portion 324 and the final 
compressed data portion 326 are produced, they are appended successively to the archive header portion 304. 

In one embodiment a recovery information portion 328 is appended to the final output file at block 516. The 
25 recovery information portion 328 includes recovery information such as the CRC about the final compressed data portion 
326. In one embodiment the second stage compression process prompts a user to determine whether to protect the final 
output file 322 against damage by appending a recovery information portion 328. In one embodiment, the recovery 
information portion 328 is also compressed. One embodiment of the final output file 322 includes the file header portion 
306 but not the compressed file header portion 324. In one embodiment the second-stage compression process updates the 
30 archive header portion 304. In one embodiment, the second-stage compression process combines the ZIP archive header 
334, the ZIP central directory header 336 and the ZIP end of central directory header 338 with the final output file 322 to 
form the ZIP-recognized output file 332, which may be recognized by any utility program that supports the ZIP file format. 
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A utility program that recognizes the ZIP-recognized output file 332 may typically list information such as file names, sizes 
before compression, sizes after compression and compression ratios of the multiple files in the sorted file list 204, and so 
forth. The second-stage compression process then proceeds to an end state at block 518. 

In another embodiment, the second-stage compression process is omitted; the archive header portion 304, the file 
header portion 306 (or the compressed file header portion 324 in another embodiment) the intermediary output file 312, 
and the recovery information portion 328 are combined to form the final output file 322. 

Additional embodiments of a multiple-file compression system and processes are illustrated in Appendix A. 
Furthermore, Appendix B includes one embodiment of a set programming code that implements an embodiment of a multiple 
file compression system and processes. The disclosed program is written in the programming language C+ +, though it is 
recognized that in other embodiments, other languages may be used. It is recognized that the specification includes the 
description disclosed in Appendix A and Appendix B. Appendix A and Appendix B form a part of this specification. 

111. CONCLUSION 

' Although the foregoing has been a description and illustration of specific embodiments of the invention, various 
modifications and changes can be made thereto by persons skilled in the art, without departing from the scope and spirit of 
the invention as defined by the following claims. One embodiment of the claimed method is implemented in C+ + computer 
programs, although other hardware, software, firmware and combinations may also be used for implementation. 
Accordingly, the breadth and the scope of the present invention should be defined only in accordance with the following 
claims and their equivalents. 
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APPENDIX A 

This appendix forms a part of the specification of the application entitled "SYSTEMS AND 
METHODS FOR MULTIPLE-FILE DATA COMPRESSION," internal reference number 

REALNET.136A 
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SYSTEM AND METHOD FOR DATA COMPRESSION 

The present inventive was designed as a compression arcMver, which gathers files to be 
compressed together and treats them as a contiguous stream of data. Files that are 
compressed are analyzed and sorted according to their extension and then the file name. 




The sorting step is requited and it is one of the most important aspects of the whole 
process, because the present invention takes advantage ofbetween-file similarities and 
the compression ratio is improved whenever the redundancy is encountered in any form. 
Sorting files hefcs putting similar extension files together as they tend to have the same 
type of information within. 



17 



WO 01/50612 



PCT/US01/00424 



[Cotn^t^igraeHBadET»us^Dynan<cMar^MDd^ 

rfefta^Dat^Ttaa. AthfaffifcllriCTtt^ far Kte 1 

Ffelfa^Dat^Tto^AttirfnrtowUhcxwipres^ for He 2 




The output stream contains three sections . The first section is the archive header p art It 
contains the whole archive information, like creation time, whole archive CRC, flags for 
det ermining whether the archive is locked or damage protected or not The second section 
is the header part, which contains all the headers and all the information required to 
uncompress and faring the files to their initial state, regardless the order they were 
compressed before. Please note that the order of decompressing files is different by the 
one of reading the files, because of the sorting process. 

The third section is the compressed stream p art There are no flags to describe the 
beginning and the end of files, but only markers for blocks. The stream contains blocks 
and a block can be seen as a contiguous stream of bytes. 

SECTIONI 
Archive Header 

SECTION n 
Header Blocks 

SECTION m 

Marker Block I -> Compressed Block I 
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Marker Block H -> Compressed Block II 
Marker Block II -> Compressed Block II 

In some cases there is even section IV, which is related to the damage protection and 
contains blocks of information based upon CRCs (cycKc redundancy codes) performed 
on the compressed stream blocks. 

SECTION IV 

Marker Block I -> Information Recovery Block I 
Marker Block II -> Information Recovery Block II 
Marker Block II -> Information Recovery Block E 

After the files are analyzed there are three major steps in the present inventive program. 

The First step is tile headers compression. There is only one block of information that ' 
contains the file headers and this block is compressed using Method II, described below. 
Outside foe first section ofXZIP archive, which is foe actual header, there is nothing 
which remains uncompressed. The file headers and the compressed blocks contain 
compressed data or are compressed themselves. 

The second step is foe actual compression step, which implies a slightly modified LZ77 
(called LZSS) The files previously sorted are read a dynamically allocated table (which 
can have different sizes ranging from 64Kto 8192K) is filled with the bytes read from the 
files. 



i 



-nteai^tfe flunks ^ a ajntigr^ stream] - 



buffet [64-B192Ctabte] ■ ) | fauffg [64- 8192K table] 



look ahead buffer 



[sldkigw!ndow : >req^resd»to^^ J m^con^bans easier 



5 byte HASH \Q ^ ^ 

coffiston chainsDnt indexed] (4J 

[ matches detected and sutetroigs found! 



From the begnming of the table, which acts as a sliding window, meaning that always 
matches and sub-strings will be searched within the table size, even if the table pointer 
advances because the table is doubled in size. Five bytes are hashed in two interlaced 
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four-byte keys, and then the result is compared to a 1 024K table entry. If Hie tabl e entry 
is not empty, then for every location that is chained in that entry sub-strings are searched 
and the biggest one is selected. However, a heuristic method is applied (Longest Frame 
First), and the sub-string is not selected if there is another one longer stating from the 
next character. When the sub-string with the longest length is selected, then the whole 
output will be made up of a pair of position and length. 

The whole output of this algorithm will contain basically uncompressed characters and 
position/length pairs, and 0/1 bits to determine which is which. The positions rely in the 
range of the table size from 64K to 8192K, which is from 16 bit to a 23 bit-number. This 
will be split in two different numbers, and they will fit in two different blocks. The 
former will contain the first 8 bits, and the latter will contain the rest, an 8 to 1 5 bit 
number. 

The uncompressed characters will fit in a different block, and will not occupy the same 
block as the length bytes. This will made a total of 5 output blocks, if we number the bit 
block. 



12 output buffer 1 

12 output buffer 2 j 


LZ output buffer 3 






U output buffer 4 | ( 




u out ^. buf ! gr 5 1 


1 1 


1™ 


1 1 



8bit~positton buffer 
modulo 8 btt-TnfWtB' lencjht buffer 
8-btt uncompressed characters .buffer 
o-oit pacKea lz compression Dies buffer 
12-15 tot packed position rest buffer 



Blockl- Bit block 

Block 2 - Literal block (uncompressed bytes) 

Block 3 - Length block (the sub-string length, can be unlimited and it's inserted modulo 
255) 

Block 4 - Distance block (the position of the sub-string which is kept as a distance from 
the reading pointer) 

Block 5 -Rest block (the 8-15 bit number as a rest fiom the position number) 

The third and the last step is the block compression which implies the Dynamic Huffman 
compression in three different ways. Two context techniques are applied, the Dynamic 
Markov Model (1-byte context) 
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[ lndepemtortfy compressed m ftye different trees, when using Method I t The Pynartc Huffaan CocBhpJ 



and The Pseudo-Contextual Model (1 flag, Ibyte context). 



This with the simple Dynamic Huffman which can be called a 0-byte context make three 
different compression method that are applied on the LZ output blocks. 
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Please note that only one Method, Method I, n or IH is applied on a buffer, but only 
Method II is applied on the file headers block, because of the 1 -byte context technique. 

The attached source illustrates one program in a series of separate files for implementing 
the present inventive system and method for data compression. The disclosed program is 
written in C++, although the present invention can be implemented in other languages as 
would be known to one of skill in the art 
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APPENDIX B 

This appendix forms a part of the specification of the application entitled "SYSTEMS AND 
METHODS FOR MULTIPLE-FILE DATA COMPRESSION," internal reference number 

REALNET.136A 



23 



WO 01/50612 PCT/US01/00424 



*********** 
* 

* 

* This is the user interface - console printing procedures 
* 

* 

* Prom Xtrerae 106 (DI£) package by Sabin, Belu (c) 1999 
* 

* 

* 

_ ******************************* 
***********/ 

#pragma pack (!) 

#include <stdio.h> 
#include <conio.h> 
#include < windows. h* 

#include H console. h" 
#include n exports. h n 

short ratio ; 

extern XTRBME1 0 6_CMDSTRUCTURE MyXtrStructure; 

void Printf (char *Text, char ♦delimiter, int atribute) 

if (MyXtrStincture.MinorStatusMessageDisplayFunction != NULL) 

MyXtrStructure . MinorStatusMessagelksplayFunct ion (Text , delimit 
er, atribute) ; 

} 

void Print (char *Textl, char *delimiterl, int atributel, /char *Text 
2, char *delimiter2, int atribute2, 

char *Text3,.char * delimiter, int atribute3, char *Text 
4, char *delimiter4, int atribute4, 

int procent) 

if (MyXtrStructure. Ma jorStatusMessageDisplayFunction != NULL) 

MyXtrStructure .MajorStatusMessageDisplayFunction (Textl, deli 
miterl, atributel, 
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Console 

Text2, delimited, atribute2, Text3, delimited, atribute3 
, Text 4, delimiter4, atribute4, procent) ; 

} } 

int ScanForAchar(char *mess, int but_no) // a callback FileRename 
function must be implemented ! 

if (MyXtrStructure.Utility_Function != NULL) 

return (MyXtrStructure.ytility_Punction (mess, but no) ) ; 

else 

return 'N 1 ; // no as answer 

} <" 
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console 



int ScanPorAchar (char *raess, int but_no) ; 

void Printf(char *Text, char *delitniter, int atribute) 

void Print (char *Textl, char *delimiterl / int atributel, char *fext 

2, char *delimiter2, int atribute2, 

char *Text3, char ♦delimiters, int atribute3, char *Text 
4, char *delimiter4, int atribute4, int percent); 
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/************************************** 
*********** 



Contextual Encoding ! 

* 

The best in literals encocjing / decoding 

* 

Prom Xtreme 106 (DLL) package by Sabin, Belu 



************************ ****************************************** 
***********/ 

" #pragma'~pa~ek " (l) 

#include <string.h> 
#include <stdlib.h> 
ttinclude <conio.h> 
#include <assert.h> 
#include <stdio.h> 
#include <:io.h> 

#include "Util.h 0 
# include "Contextual.h" 
#define MAX_READ 10240 
#def ine MAX_MODELS 12 

struct contextModel XXXContextualModel [MAX__M0DELS] ; 

unsigned int Interval JLow ; 

unsigned int IntervalJLen ; 

unsigned int shifts, value 

unsigned short buffer « 0, mask =128; 

//FILE *infile; . 
//FILE *outfile; 

// extern unsigned .int XXXInBufC; 
//unsigned int XXXOutBufC; 
/ /unsigned char XXXInBuf [MAXJREAD] ; 
//unsigned char XXXOutBuf [MAX_READ * 2] ; 

struct Fill In Data Fill [ MAX MODELS + 2 ] = 
{ " 

{ 1. 0> 0, 16, 12}, { 1, 1, o, 2, 

4 )/ 
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TTimsigned int textsize, printcouiitY outcount,* codesize; 
#define MINIM(a,b) ( (a<b) ? a : b) 

inline int retrieveContextualEncodedCode (strict contextModel *XXX) 

{ s 
register unsigned int TotalF; 

register unsigned int CummulatedLow, Low, CummulatedHigh, Range; 

register unsigned int ValuePerUnit, END; 

register short symbol =0; 

register unsigned short i; 

register unsigned short X = XXX->Step; 

CummulatedLow = CummulatedHigh = 0; 
TotalF » *XXX->TotalFrequency? 

ValuePerUnit = Interval_Len / TotalF; 

END = MINIM (TotalF - 1, value / ValuePerUnit) ; 

while (CummulatedHigh END) 

{ 

sytnbol++; 

CuirartulatedHigh += XXX->Freq [symbol] ; 
} " * ^ * . . 

Range = XXX- >Freqf symbol ] ; 

CummulatedLow = CummulatedHigh - Range; 
Low = ValuePerUnit * CummulatedLow; 

value -= Low; 

Interval_Len = (CummulatedHigh < TotalF> ? ValuePerUnit * Range 
Interval_Len - Low; 

while (Interval_Len <= HALF) . 
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Contextual 



{ 

Interval_Len <<= i ; 
if ( (mask >>= 1) ■» o) 
{ 

buffer = . XXXInBuf [XXXInBuf C++] ; 
mask s? 128; 

} 

value = (value « 1) + ((buffer & mask) != 0) ; 

} 

XXX- >Preq [symbol] += X; 

XXX- >TotalFrequency += X; 

if (XXX->TotalFrequency > XXX7>MaximumFreq) _ 

XXX- >TotalFrequency = 0; 

for(i=l; i <- XXX->SymbolsNo; i++) 

{ 

XXX->Freq[i] = (XXX->Freq[i] + 1) » 1; 

XXX->TotalFrequency += XXX->Freq[i] ; \ 

} 



return (symbol) ; 



void storeContextualEncodedCdde (struct contextModel *contextModel, 
unsigned int symbol) 

( 

register unsigned int i ; 

register unsigned short X = contextMpdel->Step; 
register unsigned int TotalF; 

register unsigned int .CummulatedLow, CummulatedHigh, Range, Low; 
register unsigned int ValuePerUnit; 

Cummulatedliow =0; 

TotalF = contextModel- >TotalFrequency; 

Range = contextModel ->Freq [symbol] ; 

ValuePerUnit « Interval_Len / TotalF; 

for(i=l; ioymbol; i++) CummulatedLow « CummulatedLow + con 

textModel->Freq[i] ; 

CummulatedHigh = CummulatedLow + contextModel->Freq [symbol] ; 
Low = ValuePerUnit * CummulatedLow; 
Interval_LOw += Low; 

IntervalJQeh = (CummulatedHigh < TotalF) ? ValuePerUnit * Range 
: Interval Len - Low; 
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// Renormalize — > 
// 

// 0 HALF p 

ULL * 

II Output bit 0 Output bit 1 

// I -] 

// A /\ 

// / \ / \ r 

// an Interval +Cummul at edLow / \ 

/ / and an Interval Len 

// 

/ / Acest if imi lua aprope o secunda 1 11 l 1 
// if (Interval_Len == 0) 

// printf("\n\n Alarm, remormalization will fail 1 \n w ); 

while (Interval_Len <= HALF) // everytime we are sending BITS - 2 b 
its out 

{ 

if (IntervalJLow + Interval_Len <= POLL) 
if { (mask >>= l) o) 

XXXOutBuf [XXXOutBuf C++] = (unsigned char) buffers- 
buffer = 0; mask = 128; 

} 

for ( ; shifts > 0; shifts--) 

buffer f= mask; 

if ( (mask »= 1) == o) 

{ 

XXXOutBuf [XXXOutBuf C++] = (unsigned char) buffer ; 
buffer = 0; mask = 128; 

else 

if (FULL <= Interval Low) 
{ 

buffer |= mask; 
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if ((mask »« 1) == o) 
{ 

XXXOutBuf [XXXOutBuf C++] = (unsigned char) buffer; 
buffer =0; mask = 128; 

} 

for ( ; shifts > 0; shifts--) 
{ 

if ( (mask »= 1) »= 0) 

{ 

XXXOutBuf [XXXOutBuf C++ J = (unsigned char) buffer; 
buffer = 0; mask = 128; 
} 

.JL 

Interval_Low -= FULL; // this is equ with -= FULL (remov- 
ing the highest bit, 1) 

> 

else 

{ 

shifts++; 

Interval_Low -= HALF; // this is equ with -= N2 (removing th 
e highest bit, 1) 

} 

Interval^ Low «= 1; 

Interval_Len «= 1; // we are increasing the interval till 

it will go above HALF 

} 

contextModel->Freq [symbol] += X; 
contextModel->TotalFrequency += X; . ; 

if (contextModel->TotalFrequency > contextModel->MaxiraumFreq) 

contextModel->TotalFrequency =0; 

for(i«l; i <= contextModel->SymbolsNo; i++) 

contextModel->Freq[i] = (contextModel->Freq[i] + 1) » i ; 
contextModel->TotalFrequency += contextModel->Freq[i] ; 

} 



} 



int get Index (int n) 

{ 
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4 Tit* ml • 

nit vai ; 


• 












val 


~~ 


14; 


else 










it in >= 




val 


=3 


13; 


else 










It [XL >= 


192; 


val 


S 


12; 


else 








it \n >= 


160) 


val 


— 


ii; 


else 










if (n >= 


128) 


val 




10; 


else 










if (n >=* 


96) 


val 




9; 


else 










if (n >= 


64) 


val 


- 
= 


8; 


else 










if (n >= 


48) 


val 


= 


7; 


else 










if (n >= 


16) 


val 




6; 


else 










if {n >= 


8) 


val 




5; 


else 










if (n >= 


4) 


val 




4; 


else 










if (n >= 


2) 


val 


= 


3; 


else 










if (n >= 


1) 


val 


S 


2; 


else 




Vpll 


a 


1; 


return val; 









} 



void ContextualEncodeBuffer (unsigned int read, unsigned char *inbuf 
, unsigned char *Outbuf , unsigned int *out) 

unsigned int i; 
unsigned int j; 

for(i=0; i < MAX MODELS; i++) 

{ . . . 

for(j=l; j <= Fill[i] .syrabolsNumber; j++) XXXContextualModel [ i 
1-Freq[j] - Fill [i] .step; 

XXXContextualModel [ i ] .TotalFrequency = Fill [i] -step * Fill [il 
.symbolsNumber; 
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XXXContextualModel [ i ] .Freq[0] XXXContextualModel [ i 
] .Freq[Fill[i] . symbol sNuniber + 1] * 0; 

XXXContextualModel [ i ] .Symbol sNo = Fill [i] .symbol sNumber; 

XXXContextualModel [ i ] .Step « Fill [i] .step; 

XXXContextualModel! i ] .MaximumFreq = 1000; 



mask = 128; 

value = 0; 

buffer = 0; 

Interval_Low =0; 

IntervalJLen = DOI_LA (BITS-1) ; . 



XXXOutBufC = 0; 
for(i-0; i< read; ~i++) 

{ 

int flag = get Index ( Inbuf [i] ) - 1; 

8toreContextualBncodedCode(«lXXXContextualModel[0] , f lag + l) ; 
if {Fill [ flag ] .flag == 0) 

storeContextualEncodedCode(SJCXXContextualModel[ fla 
g - 1 ], Inbuf [i] - Pill [ fiag ] . thresholdValue + 1); 

} 

for (i=l; i<= BITS; i++) 

{ 

register short b; 

register short bit = ( (Interval_Low » (BITS-i)) & 0xl); : 

if (bit) buffer |=* mask; 
if ( (mask »= 1) == 0) 

{ 

XXXOutBuf [XXXOutBuf C++] « (unsigned char) buffers- 
buffer « 0; mask = 128; 

} 

for ( ; shifts > 0/ shifts--) 
{ 

b = Jbit; 

if (b) buffer |= mask; 
if ( (mask >>= 1) == o) 

{ 

XXXOutBuf [XXXOutBuf C++] = (unsigned char) buffer ; 
buffer = 0; mask =: 128; 

} 

} 
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) 

if (mask != 128) XXXOutBuf [XXXOutBuf C++] = (unsigned char) buffer; 

memcpy(Outbuf , XXXOutBuf, XXXOutBuf C) ; 
*out = XXXOutBuf C; 

} 



void ContextualDecodeBuffer (unsigned, int read, unsigned char *I 
nbuf, 

unsigned char *Outbuf , unsigned int *OutNo) 

unsigned int x =_read; 

unsigned int i; 
unsigned int j ; 

for(i=0; i < MAX_MODELS ; i++) 

for(j=l; j <= Fill[i] .symbolsNumber; j+» XXXContextualModel [ 
i ].Freq[j] = Fill [i] .step; 

XXXContextualModel [ i ] .Total Frequency = Fill [i] .step * Fill [i] 
.symbolsNumber; 

XXXContextualModel! i ] .Freq[0] = XXXContextualModel [ i 

3 -Freq [Fill [i] .symbolsNumber + 1] m 0; 

. XXXContextualModel [ i ] .Symbol sNo = Fill [i] .symbolsNumber - 

XXXContextualMpdel [ i ] .Step =* Fill [i] . step; 

XXXContextualModel [ i ] .MaximumFreq = 1000; 
} • 

Interval_Low = 0; 
Interval_Len =* DOIJLA(BITS-l) ; 

■XXXInBufC = XXXOutBuf C = 0; 

memcpy (XXXInBuf , Inbuf, *OutNo) ; 

mask m 128; 
value » 0; 

buffer = XXXInBuf [XXXInBuf C++] ; 

for(i=l; i < BITS; i++) 
{ 

if ({mask »= 1) == o) 
{ 
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buffer = XXXInBuf [XXXInBuf C++] ; 
mask = 128; 

^ value - (value « l) + ((buffer & mask) l= o) ; 

while (x— ) 
{ 

0]) ^l) = (retrieVeC ° nt ^ ualtoc ^ edC ^ e <«^ContextualModel[ 

XXXOutBuf [XXXOutBuf C++] = Fill [ flag ] .flag ? Pill [ fiaa 1 
retValue : 3 

, M o -, r _ retri eveContextualEncbdedCode(&XXXCo 
ntextualModel[ flag - 1 ]) + Fill [ flag ] . thresholdValue - 1; 

*memcpy(Outbuf , XXXOutBuf, XXXOutBuf C) ; 
*OutNo = XXXOutBufC; 

} 
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/****************************^ 
*********** 



This is the crc - utility draw used 
Prom Xtreme 106 (DLL) package by Sabin, Belu (c) 1999 



* 

* 
* 
* 

* . 

* 
* 

* 

***********************************^ 
***********/ 

#pragma pack (1) 

#include <stdlib.h> 
#include n crc.h n 

void updcrc (unsigned char *s, unsigned int n, unsigned int *whatfcrc 
) ^//pointer to bytes to pump through, number of bytes in s[] */ 

register unsigned int c; /* temporary variable */ 

c = *whatcrc; 
while (n--) 

{ 

c - crcj32_tab[((int)c A (*s++) ) & Oxff] A (c » 8); 



} 



}; . 

*whatcrc = (unsigned int) (c A 1NIT jCRC_VALXJB ) ; 



void local_short_crc (unsigned char *s, unsigned int n r unsigned sho 
rt *whatcrc) //pointer to bytes to pump through, number of bytes in 
s[] */ 

{ 

unsigned int O; 

O = INIT_CRC_VALUE; 

updcrc (s, n, &0) ; //pointer to bytes to pump through, number of 
bytes in s [] */ 

*whatcrc » (unsigned short) 0; 

void locaLuint_crc (unsigned char *s, unsigned int n, unsigned int 
*whatcrc) //pointer to bytes to purap through, number of bytes in s[ 
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] */ 
{ 

unsigned int O? 

0 = INIT_CRC_VALUB; 

updcrc(s, n, &0) ; //pointer to bytes to pump through, number of 
bytes in s[] */ 

♦what crc = (unsigned int)0; 

unsigned int crc 32 tab[] = 
{ 

0XOOOOO00OL, 0X77073096L, 0xee0e612cL, 0x990951baL, 0x076dc419L, 

0x706af 48fL, 0xe963a535L, 0x9e6495a3L, 0x0edb8832L« 0x79dcb8a4I,'_ 

0xe0d5e91eL, 0x97d2d988I,/ 0x09b64c2bli7 0x7ebl7cbdL, 0xe7b82d07L! 

0x90bfld91L, 0xldb71064L, Ox6ab020f2L, 0xf3b97148L / 0x84be41deL^ 

0xladad47dL, 0x6ddde4ebL, 0xf4d4b551L / 0x83d385c7L, 0xl36c9856I>' 

0x646ba8c0L, Oxf d62f 97aL, 0x8a65c9ecL, 0xl4015c4fL, 0x63066cd9L, 

0xfa0f3d63L, 0x8d080df5L, 0x3b6e20c8L, 0x4c69105eL, Oxd56041e4L, 

0xa2677172L, 0x3c03e4dlL / 0x4b04d447L, 0xd20d85f dL, 0xa50ab56bL, 

0x35b5a8faL, 0x42b2986cL, 0xdbbbc9d6L, Oxacbcf940L, 0x32d86ce3L, 

0x45df5c75L, 0xdcd60dcfL f 0xabdl3d59L, 0x26d930acL y 0x51de003aL f 

0xc8d75180L, 0xbfd06116L, 0x21b4f 4b5L, 0x56b3c423L, 0xcfba9599L, 

0xb8bda50fL, 0x2802b89eL, 0x5f 058808L," 0xc60cd9b2L, 0xbl0be924L, 

;Ox2f6f7c87L, 0x58684cllL, 0xcl611dabL, 0xb6662d3dL, 0x76dc4190L, 

0x0idb7106L, 0x98d220bcL, Oxef d5102aL, 0x71bl8589I>, 0x06b6b51fL, 

0x9fbfe4a5I*, 0xe8b8d433L, 0x7807c9a2L, OxOf OOf 934L, 0x960938861., 

0xel0e9818L, 0x7f6a0dbbL, 0x086d3d2dL / 0x91646c97L, 0xe6635c01L, 

0x6b6b51f4L, 0xlc6c6162L, 0x856530d8L, 0xf262004eL, 0x6c0695edL, 

Oxlb01a57bL, 0x8208f4clL, 0xf50fc457L, 0x65b0d9c6L / 0xl2b7e950L, 

0x8bbeb8eaL, 0xfcb9887cL f 0x62ddlddfL, 0xl5da2d49L, 0x8cd37cf3L, 

0xfbd44c65L, 0x4db26158L, 0x3ab551ceL, Oxa3bc0074L, 0xd4bb30e2L, 

0x4adfa541L, 0x3dd895d7L, 0xa4dlc46dL, 0*d3d6f4fbL, 0x4369e96aL, 

•0x346ed9fcL, 0xad678846L, 0xda60b8d0L, 0x44042d73L, 0x33031de5L, 

0xaa0a4c5fL, 0xdd0d7cc9L f 0x5005713cL, 0x270241aaL, OxbeOblOlOL, 

0xc$0c2086L, 0x5768b525L, 0x206f 85b3L, 0xb966d409L, 0xce6le49fL, 

Ox5edef90eL, 0x29d9c998L, 0xb0d09822L, 0xc7d7a8b4L, 0x59b33dl7L, 

0x2eb40d81L, 6xb7bd5c3bL / 0xc0ba6cadL, 0xedb88320L / 0x9abfb3b6L, 

0x03b6e20cL, 0x74bld29aL, 0xead54739L, 0x9dd277afL, 0x04db2615L, 

0x73dcl683L / 0xe3630bl2Ii, 0x94643b84L, 0X0d6d6a3eL, 0x7a6a5aa8L, 

0xe40ec£0bL, 0x9309ff 9dL, 0x0a00ae27L, 0x7d079eblL, Oxf OOf 9344L, 

0x8708a3d2L, 0xle01f268L, 0x6906c2feL, 0xf762575dL / 0x806567cbL, 

0xl96c3671L, 0x6e6b06e7L, 0xfed41b76L, 0x89d32be0L / Oxl0da7a5aL, 

0x67dd4accL, Oxf 9b9df 6fL, 0x8ebeeff9L / 0xl7b7be43L / 0x60b08ed5L, 

0xd6d6a3e8L, 0xaldl937eL, 0x38d8c2c4L, 0x4fdf f 252L, 0xdlbb67f 1L, 

0xa6bc5767L / 0x3fb506ddL, 0x48b2364bL, 0xd80d2bdaL," Oxaf 0alb4cL, 
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0x36034af6L, 0x41047a60I», Oxdf 60e£c3L, 0xa867df 55L, 6x316e8eefL 

0x4669be79L, 0xcb61b38cL, 0xbc66831aL, 0x256fd2a0L, 0x5268e236l/ 

0xcc0c7795L, 0xbb0b47O3L, 0x220216b9L, 0x55052S2fL, 0xc5ba3bbel/ 

0xb2bd0b28L, 0x2bb45a92L f 0x5cb36a04L, 0xc2d7ffa7L, 0xb5d0cf3ll/ 

0x2cd99e8bL, 0x5bdeaeldL, 0x9b64c2b0L, 0xec63f226L, 0x756aa39cl/ 

0x026d930aL / Ox9c0906a9L, 0xeb0e363fL, 0X72076785L, 0x050057131,' 

0x95bf4a82L/ 0xe2b87al4L, 0x7bbl2baeL, 0x0cb61b38L, 0x92d28e9bl/ 

0xe5d5be0dL, Ox7cdcefb7L, 0x0bdbdf21L, 0x86d3d2d4L, Oxf ld4e242L* 

0x68ddb3f8L, 0xlfda836eL, 0x81bel6cdL, Oxf 6b92G5bL, 0x6fb077ell/ 

0xl8b74777L, Ox88085ae6L, Oxf f Of 6a70L, 0x660'63bcaL, OxllOlObScI,' 

0x8f659effL, 0xf862ae69L, 0x616bffd3L, 0xl66ccf45L, 0xa00ae278l/ 

0xd70dd2eeL r Ox4e048354L, 0x3903b3c2L, 0xa767266lL, 0xd06016f 71,' 

0x4969474dL, 0x3e6e77dbL, 0xaedl6a4aL, 0xd9d65adcL, 0x40df 0b66L,' 

0x37d83bf0L / 0xa9bcae53L, OxdebMecSL, 0x47b2cf7fL, Ox30b5f fe9L,' 

0xbdbdf21cL, 0xcabac28aL, 0x53b39330L, 6x24b4a3a6L, Oxbad03605I,' " 

0xcdd70693L, 0x54de5729L, 0x23d967bfL, 0xb3667a2eL, 0xc4614ab8l/ 

0x5d681b02L, 0x2a6f2b94L, 0xb40bbe37L, 0xc30c8ealL, 0x5a05df lbL 
0x2d02ef 8dL ' ' 
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*********** 



* 



* 



LZ 32, the powerful Xtreme 106 engine's engine room! 



From Xtreme 106 (DLL) package by Sabin, Belu (c) 1999 



»*****»***»»»*»»»»»»»»*^ 

***********/" 

#pragma pack (1) 

#include <stdio.h> 
ftinclude <stdio .h> 
#include <string . h> 

#include » crc . h n 

#include "util.h" 

#include n solid. h» 

#include " trees. h B 

#include "def late. h n 

#include w console vh" 

extern char Tablelndex, Solida; 
extern unsigned int SolidK, SolidN; 
extern short ratio; 

#def ine max_insert_length max_lazy_match 

#def ine P_S *++scanningj?ointer — *++matching_pointer 

#define UPDATE_HASH(h,c) (h = ( ( (h) «H_SHIFT) A (c) ) & HASH MASK) 

#define HASH_IT(x) ( { ( x A (x » 11))) & HASH MASK) " " 

#define HASHS(ul, u2) ( ( (ul A (u2 » ll))) & HASH MASK) 



#define PrintProgress {short ratio ;\ 

if (count_start > af is_start) { \ 
afis_start += 0x16000 ;\ . 
if (Solida) {\ 

if ((SolidK 1= SolidN) || (SolidN == 1) ) { 
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ratio ■ IntoarceProcent (count_sjbart, (s 
olida ? TotalSolidSize : TotalRead) ) ;\ 

sprintf (trap, n %-60s n , short strdnFile, 

60)) ;\ 

sprintf (tmp2, n %3d.%d%c B , ratio / 10, 

ratio % 10, •%') ;\ 

Print (Repack ? * Repacking n : (ZipCloa 
king ? « Zipping B : B Freezing B ) , * B , ZipCloaking ? 14 : 3, trap 
2, tmp2, B «, 3, B \r B , 0, (ratio / 10));. } }\ 

else {\ 

ratio = intoarceProcent (count_start, (s 
olida ? TotalSolidSize : TotalRead) ); \ 

sprintf Otmp, n %-60s B , short str(InFile, 

60)>;\ 

sprintf (tittp2 r ° " %*3d/%d%c n / ratio / 10, 

ratio % 10, ) ;\ 

Print (Repack ? B Repacking » : (ZipCloa 
king ? n Zipping ■ : » Freezing "), ZipCloaking ? 14 : 3, trap, 

BB , 2, tmp2, BB , 3, »\r B , 0, (ratio/ 10));} } } 



void window_fill in() 

{ " 

register unsigned int i, j; 
■unsigned int some_extra, val; 

some_extra = (unsigned int) (window_size - (unsigned int)in_advan 
cejreadihg - (unsigned int)string_starting) ; 

if (s6me_extra ==» (unsigned) EOF) some_extra--; 
else 

if (string starting >= WSIZE+MAX DIST) 

{ " . 

memcpy((char *)Fereastra, (char *)Fereastra+WSIZE, (unsigne 
d int)WSIZE) ; 

Solid_CRC = INIT_CRC_VALUE; 

updcrc ( (unsigned char *)Fereastra, (unsigned int)WSIZE, &5o 
lid_CRC); 

match_start -= WSIZE; 

string_starting -= WSIZE; 
for (i=0;i<HASH SIZB;i++) 
{ 

j =head [i] . Li ; j | =head [i] . He « 16 ; 

val = {(unsigned int ) ( j WSIZE ? j-WSIZE : 0)); 

head [i] .Li =* (unsigned short) (val) ; 

head [i] .He = (unsigned char) (val»16) ; 

for (i=0;i<WSIZE;i++) 
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{ . . 

j=prev[i] .Li; j |=prev[i] .He « 16; 
. val = ((unsigned int ) (j >=* WSIZE ? j -WSIZE : 0) ) ; 
prev[i] .Li = (unsigned short) (val) ; 
prev[i] .He = (unsigned char) (val»16) ; 

} . 

some_extra += WSIZE; 

} 

if (IBndOfFile) 

{ . 

i = read_from_f ile ( (unsigned char*)Fereastra+string_starting 
+in_advance_reading, some_extra) ; 

if (i == 0 | | i (unsigned >Int )EOP) EndOfFile = 1; 
in_advance_reading += i; 

• 7 " "" .: •• 
} 



int deflate () 

{ V • 

unsigned int hash_head ; 

chain 

unsigned int Ul, U2, val; 

unsigned int previous_matching_pointer; 
// previous . mat ching_j>ointer 

int raatch_available = 0 ; 
ous tnatching_jpointer exists 

register unsigned match_length = MIN_MATCH-1; 
st matching_pointer 

unsigned long K » 0; 

ratio =0; 
Tree jStart ( ) ; 
Print_Start() ; 

while (in advance_reading 1= 0) 

{ 

PrintProgress 

Ul = * (unsigned int *) (Fereastra + string_starting) ; 
U2 = * (unsigned int *) (Fereastra + string_starting + 1) ; 
hashjieader = HASHS(U1, U2) ; 
hash_head =head [hash_header] .Li; " 
hash_head | =head [hash_header] .He « 16; 
val = ( (string_starting) & WMASK):; 
prev[val] .Li = (unsigned short) (hash_head) ; 



//head of hash 

// set if previ 
// length of be 
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prev[val] .He =» (unsigned char) (hashjbead»l6) ; 
head[hash_header] .Li = (unsigned short) (string_starting) ; 
head [hashjieader] .He » (unsigned char) (string_starting»l6) 

prev_length » match_length, previousjmatchingjpo inter « mat 
ch_start; 

match_length = MISMATCH- 1; . 

if (hash_head != 0 && prev_length < max_lazy_match && strin 
g_starting - hash head <= MAX DIST) 
{ 

//match_length = tell_theJLongest_match (hashjiead) ; 
register int len? 

register int best^len = prev_length; 



unsigned int curjmatch = hash_head ; 

unsigned short chainJLength = max_chain_length 

; // max hash chain length 

register unsigned char *scanning_jpointer = Fereastra 
+ string_starting; // current string \. 

register unsigned chair *matching_pointer; 
// matched string 

unsigned int limit = string_starting 

> (unsigned int )MAX_DIST ? st r ingest art ing - (unsigned int )MAXJDI 
ST : 0; // nil =0 

register unsigned char *strend m Fereastra + stri 
ng_starting + MAXJMATCH; 

register unsigned char scan_end = scanning_j>ointer 

[best_len] ; 

register unsigned char scan_endl = scanning_pointer 

[best_len-l] ; 

unsigned int val ; 
char condl, cond2; 

if (prevJLength >=* goodjmatch) chain_JLength »= 2; 

for(;;) 
{ 

matchingjpointer = Fereastra + curjnatch; 

// This is a method of getting rid quickly of match 
es that are alledgedly bigger 

// than the current one ! 

//We can really get rid very quickly of a matching 
^pointer by checking it's boundary, only ! 
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if (bestJLen >= 5) 
{ 

if (matchingjpointer [best_len] l=* scan_end || 
matchingjpointer [best_len-l] !» scan_endl) goto 

Check; 

} 

if (* (unsigned int *) (matchingjpointer) != *(unsigne 
d int *) (scanningjpointer) ) goto Check; 

if (* (matchingjpdinter+4) 1= * (scanning_pointer+4) ) 
goto Check; 

scanning^ pointer+=4 ; * 
raatching^j>ointer+==4 ; 

do{}while (P_S && P_S && P_S && P_S && P_S && P_S & 
& P_S Sc& P_S && scanning_pointer < strend); 

- len = MAX_MATCH - (int ) (strend - scanning jpointer) 

; *v 

scanning_poiriter = strend - MAX_MATCH; 

if (len > best_len) 

{ 

matches tart = curjmatch; 
best_len = len; 
if (len >= nice_match) break; 
scan_endl = scanning_pointer [best_len-l] ; 
, scan_end = scanning_pointer [best_len] ; 

} 

Check : val = curjmatch & WMASK; 

cur_match = prev [val] .Li; 

curjnatch |= prev [val] .He « 16; 

condl « curjnatch > limit; 

cond2 = (condl ? — chain_length 1= 0 : 0); 

if (condl sb 0 | | cond2 == 0) break; 

} 

// return best_len; 
matchjlength = best_len; 

if ( mat ch_l eng th > in_advance_reading) matchJLength = 
in^advance_reading ; 

if (matchJLength == MIN_MATCH && s tring_s tart ing- mate 
h_start > TOOJDISTANT) match_length-- ; 
} 

if . (prevJLength >= MIN_MATCH && matchJLength <= prevJLength 
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int distance = string_starting - previous_matching_poin 
ter - (MIN_MATCH - (MIN_MATCH == 4 ? 2 :. 1).) ; 

int len = prevJLength - MIN_MATCH; 
in_advance_reading prev_length-l; 
prevJLength -= 2; 
do { 

string_starting ++; 
count_start++ ; 

Ul « * (unsigned int *) (Fereastra + str ingest art ing 

); . . 

U2 = * (unsigned int *) (Fereastra + \string_$tarting 
+ 1); - 
hashjieader = HASHS (Ul, U2 ) ; 
hash_head=head [hash_header] .Li; 
hash_head | =head [hashjieader ] .He < < 16; 
val = { (string_starting) & WMASK) ; 
prevtval] .Li « (unsigned short) (hashjhead) ; 
pi:ev[val] *Hc = (unsigned char) (hashjiead»16) ; 
head [hashjieader] .Li = (unsigned short) (string_sta 

rting) ; 

head [hashjieader] .He ■« (unsigned char) (string_star 

ting»16) ; 

} while (--prev_length !- 0); % : 
match_available = 0; 
match_length = MIN_MATCH-1; 
string_starting++ ; 
count_start++ ; 

Tree_Encode (distance + 1, len); 

} 

else 

if (match_available) 
{ 

Tree_Encode(0, Fereastra [string_starting-l] ) ; 
string_starting++; : 
count_start++; 
in_advance_reading — ; 

} 

else 

{ 

mat ch_avail able = 1; 
stringjstarting++; 
in_advance_reading — ; 
count_start++ ; 

} 

while (EndOf File « 0 && in_advance_reading < MIN_LOOKAHEAD ) win 
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dow_fill in() r - 
} 

if {match available) 

{ 

Tree_Encode ( 0 , Fereastra [string_starting-l] ) ; 



Tree_Flush() ; 
PrintPr ogres s 

return 1; 

} 

int inflate () - 

{ 

int Dis=0, Pos=0, Len=0, Len2=0, stop =0; 
unsigned int CurPos = 0, i=0, j=0, k=0; 
unsigned int flags » 0; 

for(;Read_Block() « 0;) \ 

{ 

if (restbits > 8) 

{ 

restbits-=9; 
stop =1; 

} 

else stop = 0; 

for (i=0; i < BitBufC; i++) 

{ 

flags = BitBuf [i] ; 

k = (i == BitBufC - 1? (restbits == 0 ? 8 : restbits) : 8) 

for(j=0;. j < k; j++) 
{ 

if (flags & 1) 
{ 

Fereastra [CurPos++] = LitBuf [LitBuf C++] ; 

if (CUrPOS mm WSIZE) 

{ 

f lushjwindow(CurPos) ; 
CurPos = 0; 

} 

} 

else 

{ 

Dia = DistBuf iDistBuf C++] ; 
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Dis «= D_RESTJBITS; 

Dis |= (RestBuf2[RestBufC2++] « (D_RESTJ3ITS - 8)) 
Dis | » (RestBufl[RestBufCl++] & OxFF) ; 
Pos = (CurPos - Dis - (MIN_MATCH - (MINMATCH == 4 ? 
3 : 2))) & (WSIZB-1); 

Len = LenBuf [LenBuf C++] ; 

if (Len == 255) 

{ 

Len = LenBuf [LenBuf C++] ; 
Len2 =' LenBuf [LenBuf C++] ; 

Len |= ((Len2 & OxOOff) « 8); 

} 

Len += MINJCVTCHjl 

E5: "~ ~" 

Fereastra [CurPos++] Fereastra [Pos] ; 
Pos =» (Pos + 1) & (WSIZB-1); 
if (CurPos =*= WSIZB) 
{ 

f lush_window (CurPos) ; 
CurPos =0; 

} 

if (—Len != 0) goto B5; 
flags »= l; 

) V , 

} ; ■ 

if (stop)" break; 

} 

f lush_window ( CurPos ) ; 

sprintf (trap/ » %-63s », InFile) ; 

sprintf (tmp2, "%s", (TotalSum ? "not OK" : "Ok")); 
if (Solida == 0 ) 
{ . • 

Print (tmp," 2, "melted", " ", 3, Solida == 0 ? tmp2 : ■ 
*, «\n", 4, »», »», 0, -1); 
} 

. return 0 ; 

} 
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# include <stdio.h> 
#include <stdlib.h> 
#include <string.h> 

#include 11 huff man. h n 

#def ine STATES_NO 1 

FILE *infile, *outfile; 

short X; 

uns igned int out count = 0 ; 
unsigned char inbitstringlen = 0; 
unsigned int inbitstringbuf = 0; 
unsigned int outbitstringbuf = 0; 
unsigned char outbitstringlen = 0; 

struct HuffmanTree GTree;// GallagerTree [STATBS_NO] ; 



void EncodeBuff er (unsigned int Size, unsigned , char *Buffer, unsigne 
d char *0utBuff , unsigned int *outcnt) 

{ 

unsigned int code; 
unsigned int code_buff ; 
unsigned int code_length, k, k2; 
int terap_freq; 

int sonjLndex, sibling_index, dad_code, sibling_code; 
int dadl_index, dad2_index, dad_index; 



(*outcnt)=»0; .* 
outbitstringlen - 0; ■• 
outbitstringbuf « 0; 

for (codejbuff = 0.; code_buff < MAXJZHARACTBRS ; codeJbuff++) 
GTree. Spl_Freq [code_buf f ] = 1; 

GTree. Spl_Son [codejbuff] m codejbuff + ROOTPLUSONE; 
<5Tree.SplJDad [codejbuff + ROOTPLUSONE] = codejbuff; 



for (codejbuff = 0, code_length = MAX_CHARACTERS ; code_length <= 
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ROOT; code_buff += 2, code length++) 
{ 

CTree .Spl_Freq[code_length] =* GTree • Spl_Freq [codejbuff] + g 
Tree.Spl_Freq [codejbuff + 1] ; 

GTree . SplJSon [code_length] « codejbuff; 

GTree. SplJDad [codejbuff + 1] = code_length; 

GTree. Spl_Dad [codejbuff] = GTree . SplJDad [codejbuff + l] ; 

GTree. Spl_Freq [ROOTPLUSONE] = 65535; 
GTree . Spl JDad [ROOT] = 0; 

for(k2 = 0; k2 < Size; k2++) 

{ 

code = Buffer[k2]; 
codejbuff =0; 

codeJ.ength = 0; 
k =5 GTree. Spl_Dad [code + ROOTPLUSONE]; 

for ( ; ; ) 
{ 

codejbuff »= 1; 

codejbuff += (k & 1) ? MAXJFREQ : 0; 
code JLength++ ; 

k = GTree . SplJDad [k] ; 

if (k ROOT) break; 

} 



outbitstringbuf |= codejbuff » outbitstringlen; 
if ((outbitstringlen += code_length) >= 8) 

OutBuff [(*outcnt)++] m (unsigned char) (outbitstringbuf » 



8) 



outbitstringlen -= 8; 
if (outbitstringlen >= 8) 

OutBuff [(*outcnt)++] = (unsigned char) (outbitstringbuf ) 



inglen) ; 

} 

else 

{ 



outbitstringlen -= 8; 

outbitstringbuf = codejbuff « (code_length - outbitstr 
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) 



outbitstringbuf «= 8; 

} 

} 

if (GTree.Spl_Preq[ROOT] == MAX FREQ) 
{ 

dad2_index =0; 

for (dadl_index =0; dadl_ihdex < ROOTPLUSONB; dadl_index++ 



{ ■ •• 

if (GTree.Spl_Son[dadl index] >= ROOTPLUSONE) 

{ 

GTree . Spl_Freq [dad2_index] = (GTree . Spl_Freq [dadl_index 

.J._+.iL».ii. 

GTree. Spl_Son [dad2_index++] = GTree . Spl_Son [dadl_index 

J; 

} 

} 

for (dadl_index = 0, dad2_index = M&X_CHARACTERS ; dad2_inde 
x < ROOTPLUSONE; dadl_index += 2, dad2 index++) 
-{ 

dad_index = dadl_index + 1; 

GTree . Spl_Freq [dad2_index] = GTree . Spl_Freq [dadl_index] + 
GTree . SpljFreq [dad_index] ; 

t'emp_freq = GTree . Spl_Freq [dad2_index] ; 
dad_index = dad2_jindex - 1; 

for .(dad_index; GTree . Spl^Freq [dad_index] > te«ip_freq 
; dad_index — ) ; dad_index++; ' ' 

for (int u = dad2_index - dad_index - 1; u >= 0 ; u-- 
) GTree. Spl_Freq [dad_index + u + 1] = QTree . Spl JFreq [dadJLndex + u] 
GTree .Spl_Freq[dad_index] = temp_freq ; 

for (int uu = dad2_index - dad_index - 1; uu >= 0 ; u 
u--) CTree. Spl_Son [dad_index + uu + 1] = GTree . Spl_Soh [dad_index + 
uu]; GTree. Spl_Son[dad_index] = dadl index; 
} 

for (dadl_index = 0; dadl_index < ROOTPLUSONE; dadl index++ 

) 

{ 

dad_index = GTree . Spl_Son [dadl_index] ; 
if (da<J_index >= ROOTPLUSONE) GTree . SplJDad [dadJLiidex] = 
dadl_index; 

else 

{ 

GTree. Spl_Dad [dad_index + 1] = dadl_index;. 
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GTree . Spl_Dad [dad_index] = GTree .Spl_Dad [dad index 

+ U; 

} 

} 

} 

code = GTree. SplJDad [code + ROOTPLUSONB] ; 

for( f; ) 
{ 

GTree . Spl_Freq [code] ++ ; 
dad_code = GTree. Spl_Freq [code] ; 
sibling_code = code + 1; 



if (GTree. Spl_Freq [sibling_code] < dad_code) 

for( ;; ) 
{ 

sibling_code ++; 

if(dad_code <= GTree. Spl_Freq [s±biing_code] ) 
sibling_code-- ; 

break; 

} 

} 

GTree . Spl_Freq [code] = GTree . Spl_Freq tsibling_code] ; 
GTree. SplJFreq[sibling_code] = dad_cbde; 
. sou_index = GTree . Spl_j5on [code] ; 
GTree.Spl_Dad[son_index] = sibling_code; 

if (son_index < ROOTPLUSONB) GTree, SplJDad [son_index + 1] 
= sibling_code; 

sibling_index = GTree. Spl JSon [sibling_ct>de] ; 
GTree. Spl_Son [sibling_code] » son_index; 
GTree. Spl_Dad[sibling_index] = code; 

if (sibling_index < ROOTPLUSONB) GTree. Spl_Dad [sibling_in 
dex + 1] = code; 

GTree. Spl_Son [code] = sibling_index; 
code = sibling code; 

} 

code = GTree. SplJDad [code] ; 
if (code == 0) break; 

} 

} 

if (outbitstringlen) 
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{ 

OutBuff [(*outcnt)++J =» (unsigned char) (outbitstringbuf » 8); 



} 

void DecodeBuf fer (unsigned int Size, unsigned char *Buffer, unsigne 
d char *OutBuff , unsigned int *outcnt) 

. { 

int tmpl, tmp2, code; 

unsigned int incontor = 0; 
ifct temp_freq; 

int son_index, sibling_index, dad_code, sibling_code; 
irit ~dadl_ihdex, dad2_index, d^djlndex; 



(*outcnt) =s 0; 
inbitstringlen = 0; 
inbitstringbuf = 0; 

for (tmpl = 0; tmpl < MAX_CHARACTERS; tmpl++) 

{ 

GTree.Spl_Freq[tmpl] =1; 

GTree *Spl_Son [tmpl] » tmpl + ROOTPLUSONE ; 
GTree.Spl__Dad[tmpl + ROOTPLUSONE] a- tmpl; 

} 

for (tmpl = 0, tirip2 = MAX_CHARACTERS ; tmp2 <= ROOT; tmpl +=2, tm 
p2++) 

{ 

GTree . Spl_Freq [tmp2] = GTree „ Spl_Freq [trapl] + GTree . Spl_Fre 
q [tmpl + 1] ; 

GTree . SpljSon [tmp2] = tmpl; 

GTree . Spl_Dad [tmpl + 1] = tmp2; 

GTree . Spl_Dad [tmpl] = GTree . Spl Dad [tmpl + 1] ; 

} 

GTree . Spl_Freq [ROOTPLUSONE] .« 65535; 
GTree . Spl_Dad [ROOT] =0; 

for (unsigned int k = 0; k < Size; k++ ) 

{ 

code = GTree . SpljSon [ROOT] ; 
for(r:> 
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if (code >= ROOTPLUSONE) break/ 
for( ;/ ) 

{ 

if (inbitstringlen > 8) break; 
x = Buffer [incontor++] ; 

inbitstringbuf | = x « (8 - inbitstringlen); 
inbitBtringlen +=8; 

} 

x = inbitstringbuf; . m ? 
inbitstringbuf «= 1; 
inbitstringlen — ; 

code += (x < 0) ; 

code «"* CTree .Spl_Son [code] ; 

} 

code - s= . ROOTPLUSONE ; 
int xcode = code; 

if (GTree . Spl_Freq [ROOT] == MAX_FREQ) 

{ • 
dad2_i*ndex =0; 

for (dadl_index = 0; dadl_index < ROOTPLUSONE; dadl_index->-+ ) 

r". 

if iGTree.Spl Son [dadl index] >= ROOTPLUSONE) 
f ' 

GTree . Spl_Freq [dad2_index] = (GTree . Spl_Freq [dadl_index 
] + 1) » 1; . 

GTree . Spl_Son [dad2_index++] = GTree. Spl_Son[dadl_index 
1; ■ 

• } 
} ■ 

for (dadl_index = 6/ dad2_index = MAX_ CHARACTERS ; dad2_index 
< ROOTPLUSONE; dadl_index += 2, dad2_index++) 

{ 

dad^index = dadl_index + 1; 

GTree * Spl_Freq [dad2_jLndex] » GTree . SplJFreq [dadi_index] + 
GTree • SplJFreq [dad_index] 

temp_freq = GTree - Spl_Freq [dad2_index] ; 
dadjLndex = dad2_index - 1; 

for (dad_index; GTree . Spl_Freq [dad_index] > temp_freq; 
dadjlndex- - ) ; dad_index+ + ; 
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for(int u = dad2_index - dad_index - 1; u >= 0 ; u ~) 
GTree . Spl_Freq [dad_index + u + 1] = CTree . SpljFreq [dad index + ul • 
GTree . Spl_Freq [dad_index] = terap_freq; - ~ 

for(int uu = dad2_index - dad_index - 1; uu >= 0 ; U u 
— ) GTree •Spl_Son[dad_index + uu + 1] =» GTree. Spl Son [dad index + u 
u]; GTree. Spl_Son [dad index] = dadl index; ~" ~ 

} 

for (dadl_index = 0; dadl_index < ROOTPLUSONE; dadl_index++) 
{ 

dad_index = GTree . Spl_Son [dadl_index] ; *- 
if (dad_index >= ROOTPLUSONE) GTree. Spl_Dad [dad index] = d 
adl_index; 

else 

{ 

CTree. Spl_Dad[dad_index + 1] = dadl_index ; 

GTree. Spl_Dad[dad_index] = GTree. Spl Dad [dad index + 
1] ; - 

} 

} 

} 

code = GTree. Spl_Dad [code + ROOTPLUSONE]/' 

for( ;; ) 
{ 

GTree . Spl_Freq [code] ++ ; 
dad_code = GTree . Spl Freq [code] ; 
sibling_code = code + 1/ 

if (GTree. Spl_Preq[sibling_code] < dad_code) 

for( ;7 ) 
{ 

sibling_code ++; 

if (dad_code <= GTree . Spl_Freq [sibling_code] ) 
sibling_code — ; 

break; 

GTree. Spl_Freq [code] = GTree. Spl_Freq [sibling code] ; 
GTree. Spl_Freq[sibling_code] = dad_code ; 
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son_index « GTree.Spl_Son[code] ; 
GTree.Splj3adfson_index] = sibling_code; 
if (son_index < ROOTPLUSONE) GTree.Spl Dad [son index + n 
= sibling__code; ~" ~ J 

sibling_index . GTree.Spl_Son[sibling_code] ; 
CTree. Spl_Son[sibling_code] * son_index ; 

GTree.Spl_Dad[sibling_index] m code; 

if (sibling_index < RO0TPLUSONE) GTree.Spl Dad [siblinq ind 
ex + 1] = code; ~ a - 

GTree.Spl_Son[code] = sibling_index ; 
c ode = sibl ing__code ; 

code = GTree.SplJDad[code] ; 
if (code o) break; 

} 

OutBuff [(*outcnt)++] = (unsigned char) (xcode) ; 



} 

unsigned char InBuf [MAX_READ] ; 
unsigned char OutBuf [MAX_READ*2] 
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/******************************************** 
*********** 
* 

* Obsolete ZIP header comversion procedures 
* 

* 

* 

* From Xtreme 106 (DLL) package by Sabin r Belu (c) 1999 

* .- 

* 

* 

****************************************************************** 
***********/ 

#pragma pack (1) 

#include "util.h" 
#include " solid. h n 
#include n string. h B 
#include n zipheads. h» 
#include "console. h n 

ZIPJKeader ; ZIP_H, ZIP_1; 

ZIP_Central_Directory_jHeader ZIP_CDH; 
ZIP_End_Of J?entral_Directory_Header ZIP_CDHE ; 

int WriteFirstZipHeader (void) 
{ 

// create a Zip Header. The zip archives do not have a special 
archive header, so 

// we will simulate 

char tmp IJ*AX_PATH] ; 

if (SolidArray [0] lRealName[l] == && SolidArray [0] .RealName [2 
1 — 'W) // the disk is in front 

{ . 

memset(tmp , 0, sizeof (tmp ) ) ; 

memcpy( (unsigned char *)&tmp [0] , (unsigned char *)&SolidAr 
ray[0] .RealName [3 J strlen (SolidArray [0] .RealName) - 3) ? 

else 

memcpy( (unsigned char *)&tmp [0] , (unsigned chair *)&SolidAr 
ray[0] -RealName [Qj , - strlen (SolidArray [0] .RealName) ) ; 
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ZIPJB. signature = 0x04034b50; 
ZIP_H. version =* 106; 
ZIP_H.generalJbit = 2; 
ZIP_H.compressionjrnethod =11; 
ZIP_H.time_ = 0; 
ZIP_H.dat e_ - 0; 
ZIP_H.crc32 =0; 
ZIPJH. compressed =0; 

ZIP_H. uncompressed = SolidArray [0] .size; 
ZIP_H.filenamel - strlenjtmp . ) ; 
ZIP_H.extra_len = sizeof (struct ARHJIeader) ; 

if (fwrite(&ZIP_H, 1, sizeof (ZIPjl) , F2) != sizeof (ZIP H) ) Erro 
r{7, »»); 

if {fwrite(&tnrp , 1, ZIPjk'.f ileiiamel, F2)" ^ ZIPjH^fileiiamei) " 

Error (7, nn ); 

//if (f write (&ARH_H, 1, sizeof (struct ARHJHeader) , F2) U sizeof 
(struct ARH_Header ) ) Error ( 7 , w ■ ) ; 

if (FWrite_ARH_Header(&ARH_H r F2)) ErrorK?, ") ; // rewritten, h 
as a 4 byte CRC built inl 



tnemcpy( (unsigned char *)&ZIP_1, (unsigned char *}&ZIP H, sizeof 
(ZIPJI)); ~ 
return 0; 

} 

int WriteZipHeaders(long *AllWritten) 

long where_to; 

char tm p [_MAX_PATH] ; 

unsigned int i, Extra = 0, Relative = 0; 

Print ( n », « n , 14, ■ Updating Zip Header . » », 14, n «, "\n n 
, 14, 14, -1); 

ZIP_1. compressed = *AllWritten; 
where_to = ftell(F2); 
rewind(F2); 

if (f write (&ZIP_1, 1, sizeof (ZIP_1) , F2) U sizeof (ZIP 1)) Error ( 
7, ""); 

fseek(F2, where_to, SEEKJSET) ; 
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. for(i =0; i<SolidN; i++) 
{ 

if (SolidArray[i] .RealName[lJ == 1 : ' && SolidArray [i] .RealName [2 
] — »\V) // the disk is in front 

{ 

memset(tnr p 0, sizeof (tm p )); 

memcpy( (unsigned char *)&tm p [0] , {unsigned char *)&SolidAr 
ray [i] .RealName [3] , strlen(SolidArray[i] .RealName) - 3); 

memset (SolidArray [i] .RealName, 0, sizeof (SolidArray [i J .RealNa 

me)); 

memcpy( (unsigned char *) fcSolidArray [i] .RealName [03 , (unsigned 
char *)&trap [0] , strlen(tmp )); 

} " 

} 

for(i = l; i<SolidN; i++) // first the ZIP H headers 

{ " 
ZIP_H. signature = 0x04034b50; 
ZIP_H. version = 106; 
ZIP_H. general _bit = 2; 

ZIP_H. compress ionmethod = 4;// (SolidArf ayli] .size < 40 ? 0 : ( 
(SolidArray [i] .size % 10) + 1) ) ; 

ZIP_H.time_ = (unsigned short) (SolidArray [i] .time_date) ; 

ZIP_H.date_ = (unsigned short) (SolidArray [i] .time_date » 16); 

ZIP_H.crc32 = 0xEA8CDBF6 A ((unsigned long) (SolidArray [i 

] .Size * 991111)) ;. . 

ZIP_H. compressed = 0; 

ZIP_H. uncompressed = SolidArray [i] .size; 
ZIP__H.filenamel - strlen (SolidArray [i] .RealName) ; 
ZIP_H.extra_len =0; 

if (f write (&ZIP_H, 1, sizeof (ZIP_H) , P2) 1= sizeof (ZIP_H) ) Brro 
r(7, "»); 

if (f write (&SolidArray [i] .RealName, 1, ZIPJH.f ilenamel, F2) != Z 
IP_H.filenamel) Error(7 f » n ); 
} 

where_to = ftell(F2); 

for(i =0; i<SolidN; i++) // then the other ones ! 
{ 

ZIP_CDH. signature = 0x02014b50; 
ZIP_CDH.ver = 2580; 

ZIP_CDH.ver_extr = 106; 
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ZIP_CDH.generalJbit = -2 ; . 

ZIP_CDH.compress_jn « 4;// (SolidArray [i] .size < 40 ? 0 : ( (s 

olidArrayti] .size % 10) + 1)) ; // de schepsis 

ZIP_CDH.time_date = SolidArray [i] .time_date; 

ZIP_CDH.crc32 = (i == 0 ? 0 : 0xEA8CDEF6 * ((unsigned 
long) (SolidArray [i] .size * 991111) ) ) ; 

ZIPJ3DH. compressed = (i « 0 ? ZIP_1. compressed : 0) ; 

ZIP_CDH. uncompressed « SolidArray [i] .size ; 

ZIP_CDH.file_n = strlen (SolidArray [i] .RealName) ; 

ZIP_CDH. extra_f ield = {i == 0 ? ZIP_1 . extraJLen : 0) ; 
ZIP_CDH.external_attr = 32; 
ZIP_CDH.file_comment = 0; 
_ZIP_CDH . relat^of f set = Relative ; 

Relative +=> ZIP_CDH. compressed + sizeof (ZIP_H) + ZIP_CDH*f ile_ 

• ZIP_CDH . extra_f ield; 

if (fwrite(&ZIP_CDH, 1, sizeof (ZIP_CDH) , N F2) != sizeof (ZIP CDH) 
) Error(7, nw ) ; 

if (fwrite(&SolidArr3y[i] .RealName, 1, ZIP_CDH. f ile_n , F2) 1 = 
ZIP_CDH.file_n) Error (7, ttn ); 

//if (i mm 0) fwrite(&ARH_H f l r sizeof (struct ARH_Header) , F2) ; 
if(i == 6) FWrite_ARH_Header(&ARH_H # F2) ; // rewritten, 
has a 4 byte CRC built in I 

Extra += sizeof (ZIP_CDH) + ZIP_CDH.extra_f ield + ZIPjZDH.f ile 

} 

ZIPJ3)HE.signat_erid = 0x06054b50; 
ZIPj^HE.totaljentrieshere « SolidN; 
ZIP_CDHE,total_entrieS » SolidN; 

ZIP_CDHE . size__of_cdh =: Extra; 

ZIP_CDHE . start_cdh = where_to;// + SolidN*sizeof (ZIP_CDH 

); 



if (f write (&ZIPJZDHE, 1, sizeof (ZIP_CDHE) , F2) 1= sizeof (ZIP CDHE) 
) Error (7, »"); ~ 

return 0; 

} 
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*********** 
* 

* 

* Usefull junks to keep it rolling 
* 

* 

* * From Xtreme 106 (DLL) package by Sabin, Belu (c) 1999 
* 

***********/ 



#pragma pack (l) 

#include <stdio.h> 
ftinclude <direct.h> 
#include <string.h> 
#include <stdlib.h> 

#include <fcntl.h> 
#include <sys/ types. h> 
#include <sys/stat.h> 

#include <sys/utime,h> // to modify the file time 
#inclnde <windows.h> 

#include "crc.h" 

#include "util.h" 

#include ■ solid •h" 

#include "console. h n 

#include "deflate.h" 

#include "recovery, h" 

#include "zipheads.h" 

#include "exports. h" 

_declspec( dllexport ) int Xtrerae_Archive_(char *name, unsigned in 
t *arhf ileno) ; 

unsigned int hashheader; // hash index of string to be inserted 
struct TableData conf igurationjzable [9] » 

//WSIZE_INDEX MINJMATCH MAXJKATCH HASHJBITS TOOJD ISTANT D 
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REST BITS 

1, 4, 
"32K" }, //no more 



7, 
8, 
9, 
10, 

11, 
12, 
137 
14, 
15, 

bool 



■64K B } 
"128K" 
"256K" 
■512K" 
"1024K" 
■2048K" 
"4096K" 
•8192K* 



}; 



2, 
4, 
8, 

f 

16, 

/ i 

32, 
64,. 
128, 
256, 



4, 
4, 
4, 
4, 



258, 
10000, 
20000, 
30000, 
40000, 



15, 
16, 
17, 
18, 
19, 



1/ 
It 
1, 
1, 
1* 



// it seems it does'nt give much conqpression 



4, 

4, 
4, 



.60000, 19;- 1, 

_ 62 000; ?Qj _ 1, 

64000, 20, 1, 

65200, 20, 1, 

V 



write melt = 1; 



unsigned long header_jpos = 0; // this is not the safer place for a 
initialization I 



char 

struct 

struct 



tmp [_MAX_PATH] , tmp2 [_MAXJPATH] ; 
ARH^Heade^ ARHJS; 
XTREME Header XTREMB H; 



unsigned int Totalout; outcnt; 

extern SolidFileType *SolidArray; 

int EndOfFile,nicejmatch; 
unsigned int prev_length; 
unsigned int string_starting; 
unsigned int afis_start; 
unsigned int count_start; 
unsigned int matchjstart; 
unsigned int in_advance_reading; 
unsigned short max_chain_length; 
unsigned short max_lazy__match; 
unsigned short goodjtnatch; 

unsigned int T0O_DISTANT , WSIZB, window_size, HASH_BITS, HASH_SIZ 
E, HASH_MASK, WMASK, MAXJDIST, HJSHIFT, MINJMATCH, MAXJHATCH, L_RES 
T_BITS, MIN_LOOKAHEAD; 
unsigned char HASHJMAX * 5; 
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#define ErrorMess(a, da, ca, b, db, cb, c, dc, cc, d, dd, cd) if (M 
yXtrStructure . BrrorMessageDisplayFunction) MyXt jrStructure . BrrorMes 
sageDisplayFunction(a, da, ca, b, db, cb/ c, dc, cc, d, da r ca) ; 

void Error (short errorindex, char *additionaltext) 
{ 

switch (errorindex) 
{ 

case 0 : ErrorMess(« #ERROR 1 ■ », 12, » The file «, ■»■■, 
2 , short_str (addi t ionaltext , 60 ) , ? 1 ■ , 2 , 

" could not be opened !\n 
File does not exists, could not be created, or too many open files" 
, n ?!", 2); 

break; 

case 1 : ErrorMess(" #ERROR 2 8 12, * Archive "»", 
2, short_str (Destination, 60), H,n , 2, p cannot be recognized ll\ 
n % ■ ?!", 2); 

//TryToRepair () ; 
break; \. 

case 2 : ErrorMess(" #ERROR 3 », n 0 , 12, B Archive.*, "■», 
2, short_str (Destination, 60), n,n , 2, n is damaged !l\n w , n ?!« 
, 2); 

//TryToRepair () ; 
break; 

case 3 : ErrprMessC #KRROR 4 B , " n , 12, ■ Inconsistent dat 
a crc, data write failed w , %, n ", 2, * w , ■ ?!", 2); 

break; 



case 4 : ErrorMess(" #ERROR 5 n u , 12, ■ Inconsistent data 
crc, data read failed !», »», 2, " n , nn , 2, » ■ ?! n , 2) ; 

//TryToRepair () ; / 

break; 

case 5 : BrrorMess(» #ERROR 6 n , ■ 12, * Error packing fi 
le names ! », ww , 2, 2, * », ■ ?!«, 2); 

break; 

case 6 : ErrorMessC #ERROR 7 w , ■ w , 12, 0 Error melting fi 
le names ! », " n , 2, 2, 0 ■ ?! n , 2) ; 

//TryToRepair () ; 
break; 
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case 7 : BrrorMess{" #ERROR 8 ", ■ ", 12, » Error writting t 
he archive header ! ", "", 2, "", 2, n ", " 2); 

break; 

case 8 : ErrorMess (" #ERROR 9 ", " ", 12, " Error reading th 
e next header ! ", nn , 2, "", 2, " ", " ?!*, 2) ; 

/ /TryToRepair { ) ; 
break; 

case 9 : ErrorMess (" #ERROR 10 ", " ", 12, » Unexpected END-O 
F -ARCHIVE encountered I ", 2, "", «", 2, " «, " 2); 

/ /TryToRepair ( ) ; 
break; 

"case 10 : ErrorMess{ n #ERROR li ", " Piie size n , 12, Destinat 
ion, "size changed since scanning I", 2, n Decompression will no lo 
nger be error-free l n , 2, ■ ■ 2); 

break; 

case 11 : ErrorMess ( * #ERROR 12 n , n Archive ", 12, Destinatio 
n, n cannot be processed! ", 2, "", "", 2, " », " ?!", 2); 
break; 

case 12 ; ErrorMess (" # ERROR 13 ", nM , 12, Destination, " 
seems to have no files ! ", 2, 11 ", "", 2, » ", ■ ?i", 2); 
break; 

case 13 ErrorMess ( " #ERROR 14 ", " Unable to modify LOCK 
ED archive ", 12, Destination, " Create, a new archive by extracting 
/deleting/repacking files.", 2, nn , "", 2, " w , n ?l",.2); 
break; 

case 14 : ErrorMess (" #ERROR 15 ", "Recovery record not found 
12, Destination, "The archive must have been protected first {*. 
p'rotect command) I", 2, "", 2, n ", " ?!", 2) ; 

break; 

case 15 : ErrorMess (" #ERR0R 15 ", "Recovery record found I", 
12 f Destination, "Archive is already protected i", 2, "», "", 2, " 
" ?!", 2); 

break; 

case 16 : ErrorMess ( M #ERR0R 15 ", "Inconsistent header in 
formation 1 If header CRC error ", 12, "", » was not reported, DLL 
received garbage data", 2, "", "", 2, " ", " ?■", 2); 
break; 
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void Print Start () 

{. 

afis_start =0; 
count_start = 0x001; 

} 

int CreateTemporaryArchive(char ; *DestinationDir, char *terap_name) 

char terapex [ _MAX_PATH ] ; 

memsetttempex, 0/ sizeof (terapex) ) ; 

memset (temp_name, 0, _MAX_PATH) ; 

strcpy (terapex, DestinationDir) ; . " 

strcat (terapex, "xtremly . trap" ) ; 

if {(F2 = f open (terapex, n wb+ B ) ) ==NULL) return 1; 

strcpy(temp_narae, tempex) ; 

return 0; 

} N 

int file_exists(char *disk, char *filename) 
{ char tmp [_MAX_PATH] ; 

raemset(tmp, 0, sizeof (_MAX_PATH) ) ; 

if(disk[0]) 

{ 

strcpy (trap, disk); 

if (trap [strlen (trap) -1] »\V) strcat (trap, "\\") ; 

strcat (trap, filename); 
return . (access (trap, 0) == 0); 



short IntoarceProcent (unsigned long A, unsigned long B) 
{ unsigned long Oli, Olil; 

if (A > 100000010 Oli = A/1000, Olil = B/1000; 

else Oli = A, Olil =» B; 
return (short) ( (Oli * 1000) / (Olil « o ? 1 : Olil)); 



char *shortjBtr(char *olds, int cat) 
static char trap3 [_MAX_PATH] ; 
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if (strlen(olds) > (unsigned mil./ wat/ 

{ 

memset (tmp3, 0, sizeof (tmp3) ) ; 
strcpy { tmp3 , » , . ■ ) ; 

strcat(tmp3, (char *) fcolds [strlen(olds) - cat + 2] ) ; 
return tmp3; 

} 

else 

return olds; 

} 



extern void window_£ ill_in() ; 

void initialize_engine (short pack level) 

{ 

register unsigned int j; 

if (Fereastra == NULL | J prev — NULL | J head =«= NULL) { Error (1 
1, "»); exit(O); } V 
for (j - 0; j < HASH_SIZE; j++) 

. { 

head[j] .Li = (unsigned short) 0x0000; 
head [j] .He » (unsigned char) 0x00; 

} 

string_starting =0; 

max_lazy_jmatch = 32; good_match * 8; nice_match = 128; max_chai 
n_length = 1024; 

in_advance_reading * read_from_f ile ( (unsigned char *) Fereastra 
, (unsigned int)WSIZB); 

if ( in_advance_r eading == 0 | | in_advance_reading == (unsigned 
int )E0F) { EndOfFile = 1, in_advance^reading = 0; return; } 

EndOfFile = 0; 

while (in_advance_reading. < MINJUX)KAHEAD && I EndOfFile) window 
_fill_in(); 

hash_header =0; 

} 

void Split (char *Name, char *drv, char *dir, char *fnam, char *ext) 
_splitpath(Name, drv, dir, fnam, ext) ; 

//_strlwr(drv != NULL ? drv : " °); _strlwr (dir 1= NULL ? dir : 

//_strlwr(fnam != NULL ? fnam : ■ n ); _strlwr (ext 1= NULL ? ext 
• w tt ); 
} 
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void ComplexSplit (char *Name, char *drv f char *dir,.char *fnam, cha 
r *ext) 

{ * 
FILE *U; 

char curr [_MAX_PATH] ; 

U ■ f open (Name, w r w ) ; 
_splitpath(Name, drv, dir, fnam, ext); 

if (U != NULL) f close (U); 

else 

{ 

// a directory or a directory withh a *.c, *., *.???? 

jgetcwd {curr, sizeof (curr) ) ; . 

if (_chdir(Name) *» -1) 

{ 

// must have a special *.*, or *. because we cannot change th 
e path rightly 

} 

else 

{ 

_chdir (curr ) ; // otherwise the updated archive will come here 

I ; 

if (dir != NULL) 
{ 

strcat(dir, fnam); 

if (ext [1] 1= '*') strcat (dir, ' ext) ; 

CheckSlash(dir); // if (dir [strlen(dir) -1] 1= »\\ 
') strcat (dir, n \\ n ); 

memset (f nam, 0, sizeof (fnam) ) ; : 

} 

if (fnam != NULL && fnam[0]- == 0) gtrcpy (fnam, **») ; 
if (ext != NULL && ext [0] »» o) strcpy(ext, ".*"); 
if (dir (0] mm. »\\«) { strcpy(dir, (char *) &dir [1] ) ; strcat(drv 
, "\\"); } 
} 

//_strlwr (drv != NULL ? drv : » »); _strlwr (dir 1= NULL ? dir : 
■ "); 

//_strlwr (fnam != NULL ? fnam : " n ) ; _strlwr (ext != NULL ? ext : 
■ "); 

} 

void GetCurDir (char *temp) 
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memset (temp, 0, _MAX_PATH) ; 
jget cwd ( temp , _MAX_PATH) ; 
if (temp [strlen (temp) - 1] |= »\V) strcat(temp, M \\ B ) ; 



void GetTemporaryDirectory(char *buffer) 

memset (buff er, 0, _J4AX_PATH) ; 
GetTempPath(J4AX_PATH, buffer); 

if (buffer [strlen (buffer) - 1] r !» ' \\ » ) . strcat (buf f er, n \\") 



int _unlinkjpath(char *path, char kill_directory) w 

char drive [_MAX_PATH] ; 
char direct [_MAX_PATH] ; 
char dir • [_MAX_DIR] ; 
char fname [_MAX_FNAME] ; 

char ext [_MAX_EXT] ; v 
int er; 

. memset (direct, 0, sizeof (direct) ) ; memset (drive, 0, sizeof (drive 
. ) ) ; memset (dir, 0 , sizeof (dir) ) ; memset (fname , 0 , sizeof (fname) ) 
; memset (ext, 0, sizeof (ext) ) ; 

splitpath(path, drive, dir, fname, ext); 
strcat (drive, dir>; 
strcat (direct, drive); 
strcat (drive, fname); 
strcat (drive, ext); 
er = _unl ink { drive ) ; 
if (kill_directory) _rmdir (direct) ; 
return er; 

) . . 

void MkDir(char *MDir) 
{ unsigned char a=0, j»0; 

char TM [_MAXJPATH] ; 

// This is my special MKKDIR procedure : 
// Creates a special directory like 

// W C:\\D\\T\\Y\\U7\\7\12\\12121\\6565\\87878\\787 

// required when decompression, even if for instance D\\T\\Y\\U 

7 

// do not exist I 
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memset (TM, 0, _MAX_PATH) ; 
while ((a = MDir[j++]) ! = 0) 
{ 

if(a.== «\V) Tnkdir(TM); 
TM[strlen(TM)] = a;. . 



) ' • ■ 

int Verify (char *Name, char * Symbol, char LenN, char LenS) // Syrabo 
l=????top, ==> Name=desktop 
{ char j ; 

char m = LenS < LenN ? LenS : LenN; . 
char S[300J / 
char N[300] ; 

if ((Istrpbrk (Symbol, n * n ) ) && (LenS 1= LenN)) return 0; 

strcpy(S, Symbol); strlwr(S); 
strcpy(N, Name ); strlwr(N); 
for (j=0; j < m; j++) V 

{ 

if(S[j] mm || s[j]==»!« || S[j]=='?«); // Can be anything 

else 

if(S[j] != N[j]) return 0; J 

} . • 

return 1; 

. extern XTREME106_CMDSTRUCTURE MyXtrStructure; 

void Fclose(FILB *0, unsigned int _SolidArray Index, unsigned int al 
lowed) 

{ 

struct _utimbuf times; // set file's modification time 1 
char RealPathToFile [_MAX_PATH*2] ; 

memset ( (unsigned char *) RealPathToFile, 0, sizeof (RealPathToFile 

)); 

if (0) 
{ 

f close (O) ; 
if (allowed) 

{ 

times „ act ime = (time_t) SolidArray [jSolidArraylndex] . time_d 
ate; //(time_t) (date_and_tirae) ; 

times. modt ime = (tirae_t) SolidArray [_SolidArrayIndex] .time__d 



68 



WO 01/50612 



Util 



PCT/US01/00424 



ate; // (tirae_t) (date_and_tirae) ; 

strcpy (RealPathToFile , MyXtrStructure . extractionDirector 

y) ; 

CheckSlash (RealPathToFile) 
strcat (RealPathToPile , SolidArray [JSolidArray Index] . RealName 

); 

SetPileAttributes (RealPathToFile/*SolidArray [_SolidArrayInde 
x] .RealName*/, 32); 

// first, we clear the attribute, then set the right one 



' ~ ~_utime (RealPathT<^ 
Name*/, fctiroes) ; 

SetFileAttributes (RealPathToFile/*SolidArray [jSolidArray 
Index] .RealName*/, SolidArray [_SolidArrayIndex] .atrib) ; 

_utime (RealPathToFile/*SolidArray [_SolidArrayIndex] .RealName 
*/, &times) ; \ . 

} . 

} 

} , 

int OpenFile(char *Nam, unsigned int date_and_time, unsigned char a 
ttrib) ' 

{ char dir [_MAX_PATH] ; 
char dir2 [ J4AXJPATH] ; 
char Tmp [_MAX_PATH] ; 
char Name [_MAX_PATH] ; 

memset (dir2, 0, JMAXJ?ATH) ; memset (dir, 0, JMAXJDIR) ; memset (Tmp 
, 0, JMAX_PATH) ; memset (Name, 0, _MAX_PATH) ; 
if (exttractionDestination [0] ) 

{ 

strcpy (Name, extractionDestination) ; 

//if (Name [strlen (Name) - 1] !=* »\\') strcat (Name, "W"),- 
CheckSlash(Name) ; 

} 

else • 

{ 

getcwd(Narae, _MAX_PATH) ; 

//if (Name [strlen (Name) - 1] != , \\») strcat (Name, n \\ n ); 
CheckSlash (Name) ; 

} 
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strcat (Name, Nam); 

Split (Name, dir, dir2, NULL, NULL); 
strcat ( dir , dir2 ) ; 
strcpy(Tmp, dir); 
MkDir(dir); 

if (AssumeYes == 0) 

{ 

f open (Name, »rb B )) != NULL ) 



if ( (F2 
{ 

f close (F2); 

_ sprintf (tmp. f B Overwrite %s ? (Y)es, (E)nter/ (N)o/ (A) 11/ (C)an 
eel". Name).; 

Printf (tinp, 11);- 

char t = ScanForAchar (tmp, 4); 
Printf ("», "\n», 11); 



switch (t) 

{ 

case 












r 




•A' 




case 


'a' 


: write_melt = 


1; 


AssumeYes = 


case 


'C 




case 




: write_melt = 


0; 


exit (1) ; , 


case 


l Y l 




case 


.y. 








case 


l E . 




case 
case 


13 


: writejmelt = 


l; 




case 


1 N t 




case 




: write_melt « 


0; 





br 

br 
re 



eak; 
eak; 

eak; 
turn 0; 

> 

} 

} 

// since the file cannot be overwritten if it has a read only atr 
ibute, 

// we must take care and overwrite it anyway, why bother and ask 
the user ? 

Set FileAttributes (Name, 32); // okay f it works okay 

if ((F2 = f open (Name, "wIm- 0 )) ~ NULL ) Krror(0, Name); 

return 1; // errno == 0 



int Check ARH Header (struct ARH Header *Ar) 
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{ 

unsigned int ciroco; 

/ / must be rewritten, too unsafe . . . header may contain garbage d 

ata » • » **** 

if ((unsigned char) Ar->_HeaderCRC != OxFA) return 0; 

local_uint_crc{ (unsigned char *)Ar, (unsigned int) (sizeof (struc 
t ARHHeader) - 4 /* without the CRC itself */) , (unsigned int *)&c 
iroco) ; 

if ({unsigned int) Ar->JJHeaderCRC 1= (unsigned int) ciroco) retu 
rn 0; 

return 1; // okay I 



int FWrite_ARH_Header (struct' ARH_Header *Ar, FILE *F) 

//we have a header, filled with something .... 
// just add the CRC, and it's on the file! % 
unsigned int ciroco; V 
unsigned char header _map [_MAX_PATH * 2] ; 

unsigned int headerjnap_len = (unsigned int) (sizeof (struct ARH H 
eader) - 4); /* without the CRC itself */ ~ 

Ar->_HeaderCRC = OxFA; // fill it before it gets random 

memset ( (unsigned char *) &header_map, 0, sizeof (headerjnap) ) ; 
memcpy( (unsigned, char *) &header_map, (unsigned char *)Ar, header 
map_ len) ; — 

local_uint_crc{ (unsigned char *)&header map, header map len, funs 
igned int *)&ciroco); ~ ~ - 

Ar->_UHeaderCRC = (unsigned int) ciroco; 

if CAr->_recovery_Corapressed) 

/ / there must be an error, cause I did not initialized a shit 
on these ! 

//int u = 0; 

//printf (» \n\n\n error damaged file header detected . 

..\r\n n ); 

//Printf (" \n\n\n error --> damaged file header detected 
••\r% "\n\n \ 9) ; 

//Sleep (4444) ; 
//U++; 

} 
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if (fwrite(Ar, 1, sizeof (struct ARHJIeader) , F) 1= sizeof (struct A 
RHJieader)) return 1; 
else return 0; 

.} 

int Write_Archive_Header (void) 

{ 

memset ( (unsigned char *) & (ARH_H._Name) , 0, sizeof (ARH_H,_Name) ) ; 
strcpy(ARH_H._Name f "ULBB106") ; 

//if (Actualizez) ARH_H._SolidN += SolidN; // please re-check I 
//else 

ARH_H._jSolidN = SolidN; //I think' this holds even when updating 



ARH_H._Solida = Solida; 
ARH_H._Version = 106; 
ARH_H ^Locked = 0x00; 
ARH_H._SolidaTableSize = Tablelndex; 

X. 

... if (ZipCloaking 0) 
{ 

II Okay-/ befor writting the Header down, we have to fill in the 
CRC ! 

// So, we will replace f write cu FWrite_ARH_Header 

//if (f write (&ARH_H, 1, sizeof (ARH_H) , P2) != sizeof (ARH_H) ) / 
Error(7, ""); 

if (FWrite_ARH_Header ( &ARH H, F2 ) ) Error (7 , ■ " ) ; 

} 

else 

{ 

if (Solida == 0) { Printf ( tt -s [solid mode] required on the comm 
and line*/ ■ 4); exit(0);} 
Wr iteFirst ZipHeader ( ) ; 

} 

return 0; 

} 

int FileSelection(void) 
{ 

char TmpDirekl [_MAXJPATH] , TmpDirek2 [JMAX_PATH] , UpdateExitanceFi 
leName [_MAX_PATH] ; 
unsigned int i f j; 
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cted mm i)) write_melt = 0/ 

// Chestia de deasupra e ca mi decomprimani f isierele pe care le s 
tergem, la DELETE/ UPDATE 

// deci exact ce ne trebuia, adica, punem un \ \ Extrag 
. . . pe care le vom completa \ * 

// noi Deci trebuie select ate toate f isierele care apart in 

de Sursele ... 

// de exeinplu : "program files\ n all here are selected 

// if the ■ "program files\° is in the sursele 

// the single problem is that the sursele must contain the Archiv 
eFullPath, and if 

// directory to end with a "W . 

// I don't think I "can" rely "on fsoiidBl'but it "is" "sett ed when enter 

ing the archive 

// will have to check if the questioned file is 
// among the MyXtrStructure . Sursele or not .... 

// nu among the Solid Files, ci among Sursele, and the maximum is 
MaxDirectories V 

for(i=0; i < SolidN; i++) SblidArray [i] .selected =* (Sterg || Act 
ualizez ? 0 : 1) ; // this will not be decompressed (marked to be de 
leteii'from queue) 

for<j=0; j < MyXtrStructure. MaxDirectories; 

•// okay, so extract a Sursele, add the Pathl or 2 which is now 

the archivePath 

// and so on — 

memset (TmpDirekl, 0, sizeof (TmpDirekl) ) ; 

strepy (TmpDirekl, (MyXtrStructure. Sursele [j] .PathiOr2 ? MyXtrSt 
ructure. Pathl : MyXtrStructure. Path2) ) ; 

CheckSlash (TmpDirekl) ; 
strcat (TmpDirekl , MyXtrStructure . Sursele [ j ] .Name) ; 

strlwr (TmpDirekl) ; 

// update patch only ..... 

if (strstr (TmpDirekl, " i\V) != NULL) 

{ 

// the file path is with "DISK:\\ n , when updating, so this p 
rocedufe needs patches, but it is the best ... 

memset (UpdateExitaftceFileName, 0, sizeof (UpdateExitanceFi 
leNameJf); //the name with full path 

strcpy(UpdateExitanceFileName, TmpDirekl) ; 
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meraset(TmpDirek2, 0, sizeof (TnrpDirek2) ) ; 

strcpy(TmpDirek2, (char *) iTmpDirekl [3] ) ,- ' 

meinset (TmpDirekl, 0, sizeof (TmpDirekl) ) ; 

strcpy (TmpDirekl, TmpDirek2) ; 

^ memset(TmpDirek2, 0, sizeof (TmpDirek2) ) ; 

if (MyXtrStructure.Sursele[j] .File == 0) strcat (TmpDirekl, »\\») 
; // e directory, add '\\» ' " ' 

for(i=±0; i < SolidN; i++) 

meinset (TrapDirek2, ~0, sizeof (TmpDirek2) ) ; 
strcpy(TmpDirek2, SolidArray [i] .RealName) ; 
strlwr(TmpDirek2) ; 

if (strstr(TmpDirek2, TmpDirekl) ==-TmpDirek2) 

I V 

// this file must be selected for writing 

// basically it's the other way around, but now we 
are not deleting the file 

// but selecting the others to be deleted 
// Bine bine, dar nu fac update pe un fisier, doar ca direc 
torul a fost selectat, ci il sterg doar . , r ca airec 

// daca el exista cu.adevarat, si va fi replaced .. 

• • * 

if (Actualizez ==0) 

{ 

m //«.!.. f°l id A*ray[i 1 .selected = (sterg || Actualizez ? i 

. 0); // this will be decompressed,, but I want it deleted now 

else 

{ . ;• 

if (_access(DpdateKxitancePileName, o ) == o) //*real path 

ze „ ?i n> ii ' , folidArray [i]. selected = (sterg. || Actuali 

IL J : t U 7 - 8 ? ° nly if existS ^ wil1 be replaced even if 
the directory is here ... 

} 

/ ^ ^^^t^t^e.SurseieCjl.File) goto NextFile; / 

patter the file is found, no time to waste for another file ... ah 



? 

i 
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} 

j NextPile : ; // just a j++ 
return 0; 

} 

// COMPRESSION USE ONLY 

int read_from file (unsigned char *buf, unsigned int siz) 
{ unsigned int len, /*ratio,*/ X; - 
long size = siz, verif ; 

len = fread{ (unsigned char *)buf, 1, s i ze , Pi) ; 
iy (len == (unsigned) (-i) "]) i e h == 0)"" &&'solidaj " 

len = TotalRead = ef- 
fort;,-) 

Fclose(Fl r 0, 0); \. 
// 

// Gata aici stergem f isierul 
// 

if (MyXtrStructure.sfx && SolidK) 

char Real Pa thToFi le [__MAX__PATH* 2 ] • 
PathToFile)); meraSet(( ^ Si9nedChar *) Real ^thToFil e/ 0, sizeof(Real 
aiName) ; *trc*y(RealPathToFile ,SolidArray [SolidK-1] .Re 

^ _unlink(RealPathToFile) ; 

if (SolidN =*= SolidK) 

if (MyXtrStructure . sf x) 

// cleaning up everything ( ^ XtrStrUCtUre - extractio ^^ectory, ; 

} 

break; 
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sprintf (trap, »%-69s», short_str (InFile, 69)); 
Print (Repack ? ■ Repacked » : (ZipCloaking ? » Zipped » • 
• Freezed ») , ZipCloaking ? 14 : 3, tmp, »\n», 2 »» «" n n 



); 



memset (InFile,. 0, _MAX_PATH) ; 
strcpy ( InFile , SolidArray [SolidK] . RealName) ; 
ratio = IntoarceProcent (count_start + len, TotalSolidSize 

sprintf {tmp, "%-60s», short_str (InFile, 60)); 
sprintf (tmp2, » %3d.%d%c", .ratio / 10, ratio % 10, •%•); 

— ; . - . .Print (Repack ? » Repacking » : (ZipCloaking ? » z 

lpping » : » Freezing »), »», ZipCloaking ? i~4 s 3 7 tmp; ■ '» ~2 "V 
™P2, »\r», 3, »», »», 0, (ratio/10)); ~ ' 

TotalSura = SolidArray [SolidK] .size; 

if<(Fl = fopen(InFile, »rb" )) mm -NULL ) Error (0, InFile) 

\ . 

verif = _filelength(fileno(Fl)) ; 
. if (verif != TotalSum) Error (10, »»).; // file size chan 
ged since scanning ! ! ! 1 

x = fread{ (unsigned char *)buf + len, 1, size, Fl) ; 
len += x; ' 
SolidK++; 
' if ((size -= x) <= o) break; 

> ' 

TotalRead += len; 
^ return (int)len,- 

// DECOMPRESSION Use Only 

void flush_window (unsigned int Cati) 

// We must avoid the extraction of files which will eventually be 
// deleted, so will put a simple falg to simulate this 1 
// Remember that if a file is selected to be erased --> 
// SolidArray[i] .selected = 1, and write_melt == 0; 

if (Cati == 0) return; 
Solid_CRC = INIT_CRC_VALUE; 

updcrc( (unsigned char *)Fereastra, (unsigned int) Cati, &Solid_CRC) 
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TotalSum -=Cati; 

if (Solida && (TotalSum < o)) // we have to split the. file 

TotalSum += Cati; 
if (write melt) 
{ 

P2 ); fwrite((unsi 9 ned <*« *)Fereastra, 1, (unsigned int)TotalSum, 

sprintf (trap, - %-64s» , short str(InFile, 64))- 
if (Repack == 0) ~ 

0, -1). Prlnt <^ 2, - melted", »», 3, »», »», 0 , »», » % 

}"" ."" " 

Fclose(F2, SolidK ? SolidK - 1 : SolidK, 1) ; 

unsigned long Sum = 0, Files = 0; 

for(;;) 

{ 

if (SolidK >= SolidN) break; 

memset(InFile, 0, _MAX_PATH) ; 

strcpy(lnFile, SolidArray [SolidK] .RealName) ; 

Files = SolidArray [SolidK] .size; //[ first file's size 

cay^dKKs^ed II == 1 H;**- " « « («ld»r 

. write jnelt = 0; 

else 

write_melt = 1; 

Mlta£S££3 .,SSft le(InFlle ' ^"^.ISoUdH .ti»e_aa te 

SolidK++; 

if (Files > Cati - TotalSum - Sum) (• 

+ n if { " r ^ e - m ^) fwrite( (unsigned char *)Fereastra + TotalSum 

+ Sum, 1, Cati - TotalSum - Sum, F2); 

TotalSum = Files - (Cati - TotalSum - Sum) ; 

break; 

} 

else 

{ 

if (write melt) 
{ 

fwrite( (unsigned char *)Fereastra + TotalSum + Sum, l, Fi 
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leS, F2) ; 

sprintf (trap, ■ %-64s» , short str(InFile, 64)).- 
i£ (Repack == 0) ~ 

{ 

Print(tmp, »», 2, - melted", »», 3, »« 

, 0, »», »», 0, -1); 

^Fclose(F2, SolidK ? SolidK - 1 : SolidK, 1) ; 
Sum += PileS; 

} 

} i : 

else 

i • 

if (write melt) 
{ " 

short ratio = IntoarceProcent (TotalSum, (Solida ? TotalSoli 
dSize : TotalRead) ) ; 

f write ( (unsigned char *)Fereastra, \, Cati, P2) , 
sprintf (tmp # »%-63s n , InFile) ; 

sprintf (tmp2, »%2d.%d%c», ratio/10, ratio%10, •%')- 
2, ^^V^^T Melting », - 3, trap, . S, 3, tmp 

} } 

} 



void SkipToNext_ZIP {struct ZIP_Header *Head, PILE *U) 

unsigned int x = Head->extra_len; 
while fx—) getc(u); 

fseek(U, Head->compressed, SEEK_CUR) ; 

void GotoTheSolidPackedFiles {FILE *U) 
{ char tmpPil [_MAX_PATH] ; 



rewind {PI) ; 
if {(fread(&! 

1, »«); 

if ((freadUtinpFil, 1, ZIP_H.f ilenamel, Fl) ) 1 = ZIP H.filenamel) 
Error (1, B ») ; - ' 



if ((fread(&ZlP_H, 1, sizeof (ZIP_H) , fi)) i = sizeof (ZIP H) ) Erro 
r (1/ nn ) ; ~~ 
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while (x— ) getc(U); 

int Read_ZIP_ARH_Piles() 
char tmpPil [_max_PATH] ; 
rewind (Pi) ; 

SolidM = TotalSolidSize = o- 
for( ;; ) 

{ 

UpdateSolidArray(SolidN) / 
mera8et(tmpPil, 0, sizeof (tmpFii) ) ; 

if ((fread(&ziP "h, i, sizeof (Zip &) m\\' t " " m. - - 
ror(l, ■■), ~ *eori*xi?_H) f Fl)) != sizeof (ZIP_H) ) Br 

if (ZIP_H signature 1= 0x04034b50) break; 
if(<fread(&tmpFil, l, ZIP H.filenamel, Fl) ) Z ip nf --, 
) Error (1, "«) ; - ' ' !=a z I p _H.filenamel 

V 

SkipToNext_ZIP(&ziP_H, Fl) . 

™JjS^£ ljMI += ZIE> -H.uncompressed; 
SolidFillTheNanie(SolidN, tmpPil ZIP h lmm ^ 
check for the time = o ZlP_H.uncompressed, o, 0) ; // 

SolidN++; 

} • 

GotoTfieSolidPackedFiles (Fl) ; 
return 0/ 

} 

int Xtreme.Archive^char *name, unsigned int *arhfileno) 

illt x = 6; 
PILE *U; 

ilii U ^ " f ° Pen(name ' " rb ">) == NULL) x = 0; 
e se 

if ( (fread(&ARH H, i, sizeof (ARB pri m* . ^ ^ 
= 0; - »xzeor lARH^H) # U) ) i= sizeof (ARH_H) ) x 

if ((x = Check_ARH_Header (&ARH_H) ) i) 

*arhfileno = arh H. SolidN- 
else — — ' 

j *arhfileno = o ; 

Fclose(U, 0,0); 
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return x; 

} 

int Read_Archive_Headei:(char initialize_tables) 

Read_ZIP_ARHJieader{) ; 

Solida = ARH_H . __Sol i da ; 

if (Solida && initialize_tables) 

Tablelndex » ARHH._SolidaTableSize; 
ReadjustTablesO; 

return 0; »" 

„._) 

void SkipToNextFile (PILE *FF) 
rewind (FF) ; 

fseek(FF, headerjpos + sizeof (ARH__H) , SEEK SET) ; 
/ \. 

int CheckStruct (char *p) 
{ 

long u * ftell(Fl), o; 

o = fread(&XTREME_H, 1, sizeof (XTREMfi^H) , Fl) ; 
read f ! (( ° i= sizeof (XTRKME - H ) > <° Q) ) return 1; // nothing to 
e to"ead ! = Sizeof(XTREME - H )> & * (°>) Error(9,»") ; // unabl 

TotalRead = TotalSum = XTREME_H.JsizeUUCom- 
NainLe^ 31 ^ '" XTREME - H '- NextFile " sizeof (XTREME_H) - XTREME_H. 

ioh ^ der 7 PO n S -, + \ XTREME_H._NextFile;//. + i 0 ; // Huffman tables, wh 
ich can actually be more and more ' 

ror(9f"» ( f; ead<P/ 1/ XTREMB - H -- NamLen ' P1 >> != XTREMB_H._NaoLen) Er 

Tablelndex = (char) XTREME_H . _Table ; 

if (Listez == o && Repack =» o) ReadjustTablesO; 

if (TotalWrit<0 (| p[o]==o) 

if (ARH_H._recovery_Pilesize == 0) Error (8, <">U // if we are 
not reading the recovery records ! ' " we are 
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return 1; 

} 

return 0; 

} 

void Read_ZIP_ARH_header{) 
{ unsigned int u; 

char TmpFil [_MAX_PATH] ; 

rewind (PI); 
u = getw(Fl) ; 

if (u == 0x04034b50) // PK 

ZipCloaking = 1; 
rewind (Fl) ; 

if ((fread(&ZIP_H, l f sizeof (ZIP_H) , Fl) ) 1= sizeof (ZIP_H) ) Br 
rorfl, nw ); 

if ((fread(&TmpFil, 1, ZIP_H.f ilenamel, Fl) ) J= ZIP_H.f ilenarael 
) Error (1, Hff ); 

if {(fread(&ARH_H, 1, sizeof (ARH_H) , Fl)) 1= sizeof (ARH_H) ) Er 
ror{l, ""); 
} 

else 

if (u == 0X42454C55) // ULEB 
{ 

ZipCloaking =0; 
rewind(Fl); 

if ( (fread(&ARH_H, 1, sizeof (ARH_H) , Fl)) ■ = sizeof (ARH_H) ) E 
rror(l, »»),- 

// now let's check to see that it's quite an Xtreme Archiv 

e 

// I mean Compute CRC and compare I 

if (Check J^JIeader (&ARH_H) 0) Error (1, ««); // does no 

t matchl 

} 

else Error (1, BM ); 

} 

void GetArchiveType (char *archive_type) 
if (Fl == NULL) *archive_type = -1; 



81 



WO 01/50612 PCT/US01/00424 

Util . 



*archive_type = ARHH.jSolida; 

void DamageProtectorArchive(void) 

unsigned int U * _filelength(fileno(Pl)) ; 

InitializeProtectibndnetoda, U, l) ; 
InitializeCorrectionPorFile(Fl, U,'l, metoda) , 
CpmputeDataRecoveryRecord(Pl) ; 

void RepairArchive (void) 

COMPress.RECOVERY^rbcord = ARHH. .recovery Compressed; 
// essentxal, oh my God! ~~ 

siSf o) ; iZePr ° teCti0n (ARH - H ---covery_Method, ARH_H._recovery_m e 
^InitializeCorrectionPorPileCPl, ARH_H._recovery_Pilesi 2 e / o, meto 

Repair Q ; 

Fclose(Fi, o, o); 
Fclose(F2; o, 0); 

} 

void TestRecoveryRecord(void) 

if (ARH_H.^recovery_FilesizeJ 
s crc" ° Utp ^ form a ^covery record testing based upon each block. 

C °™™*1^ = ARH_H^recovery Compressed; 

// essentxal, oh nty God I 

if {COMPRBSS_RBCOVBRy_RBCORD > 1) 

Error (16, ■ DLL garbage DATA detected . »i . 
// return; " 

// this is only for the error to be spotted ! ! | 
lesize^; 1 * 6 *^^ ARH_H._recovery_Fi 
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toda^ tialiZeCOrreCti0nF ° rFile(P1 ' ™-H._recov e ry_Fil e si 2 e, 2 , « 
CheckDataRecovery (PI ) ; 

} 



83 



WO 01/50612 



Recovery 



PCT/US01/00424 



/*************************, 
*********** " ""~~""*********************,j 



* 



* 



^Error Correcting Codes (BCC) adding/removing procedures 

* 

^ Protection at it's best, belive me 

* 

^ Prom Xtreme 106 (DLL) package by Sabih," Belu (o) 1999 



* 

*************** ****** 



***********/ ^*****^**********-*****-***-************** 



7.C DAMAGE PROTECTION TECHNOLOGY 



#def ine NON_CONSECUTIVE_NO 6 
#define PROTECTED_JBXJFFER_NO 10 
#define PROTECTED_BUFFER_SIZE 8 192 

[PJ [NON_CONSECUTIVE_NO] 
[RI 0 1 2 3 4 5 
[OJ 6 7 8 9 10 11 

M 12 " l i *x X l <=== The SeCt ° rs are no 
1 xx y J 5 * consecutive, but interlaced. . 

N X X X x i 5 f°^ eVen " the file is damaged 

O X X X X X X J dly ' 8 ** r * ati * 1 °* ™t> the 

* X X X X chances are all the same to recove 



XORRez [0] [1] [2] [3] [4] [5] 
*/ 

#pragma pack (1) 
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#include <io.h> 
#include <stdio.h> 
#include <stdlib.h> 
#include <string.h> 

#include "crch" 
#include "huf fraan.h" 
#include "utiLit" 
#include " console, h" 
#include "recovery, h" 
#include "zipheads.h" 

-^JBffWTO ..// :...W(i«H_H) //, -> that. e«ra Header. 

C V\o");* fl ' 81 " ( "" X0 '' " Ao '' •-\<". -|\0". 

char Tmp__[ _MAX_PATH] 

unsigned short VAR_NON_CONSECUTIVE NO - 3 
unsigned short VAR_PROTECTBD_BUFFER~NO = 5 
unsigned short VAR_PROTECTED_BDPFER_SIZE = 512 

unsigned char Table [PROTECTED BUFFER qTT-Rl mat -^ 

COVERY_RECORD = 0; ~ F - SIZE] ' m etoda = 0, COMPRESSORS 

S^ST* X ? R l Rez INON_CONSECUTIVE NO] [PROTECTED BUFFER ST7P1 

25. ^spsrp^ 

lon g fftrunc; 

^SctrsK. Se ° t0rSH °- Sectot.RepairedHe. PL 

void InitializeCorrectionForFilefFlLE *pp ^ ■ 

protect, unsigned char metode) ' UMl 9 Md char 

if (protect !=* 2) 

PrintfC; Scanning, please wait ... «, * «, 2 ); 
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PLen = size; 

SectorsNo = (FLen / VAR_PROTECTED_BUFFKR_S I ZB ) + 2; 

wfTsssrsirstW 11 <protect •- - 

if (protect == 1) 
{ 

rewind (Fl) ; 

aRH_H._recovery_Filesize ' -"sizfe; 

ARH - H -_ rec overy_Method = metoda,- 

f^^"^f eC ,°T ery - C ° mpreSSed = COMPRESS RECOVERY RECORD - 
.SET);' ZlPC1 °^ ) f8eek <Fl, sizeof ( Z IP_i) + KpjLfSX.*, SEEK . 

) Error"/" ^ ite(& ^~ H ' Fl, sizeof (ARHH) 

if (FWrite ARH Header (&ARH H, Fl)) Errorf? >>i // 
n, has a 4 byte c£c built in! Error (7, "»); // rewrxtte 

fseek(Fl, DATA_RECOVERY_INDEX, SEEK SET) • 
WhereData = FLen + DATA_RECOVERY_INDBX ; '* 

else 
{ 

fseek(FF, FLen + DATA_RECOVERY_INDEX / SEEK SET) - 
WbereData = FLen + DATA_RECOVERY IHDKX- '. ~ 
fftrunc = ARH_H._recovery_Filesize ; ' 

if {protect; != 2) Printf (» Scanning complete "i-, 2 ) , 

int WriteProtectStructure(FILE *FF, char flush) 
unsigned int i, k =0; 
TeT^^pI^^ NO * VAR PROTEC 

tS 3 ^! 0 ^ j5Uffer2[1024 °J'-//^R_NON_CONSBCUTIVE NO * VAR PROTEC 
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if (COMPRESS_RECOVERY_RBCORD) 

memcpy( (unsigned char *)&bufferl[ k ], {unsigned char *)&Protect 

or.n_subsectors, sizeof (unsigned short)); ct 
k += sizeof (unsigned short) ; 

memcpy( (unsigned char *)&bufferl[ k ], (unsigned char *) Protect 

or.n_buffer_size, sizeof (unsigned int) ) ; "ocect 
k += sizeof (unsigned int) ; 

for(i=0; i< VAR_NON_CONSECDTIVE_NO ; i++) 

memcpy( (unsigned char *)&bufferl[ k ], (unsigned char *)&Prote 
ctor.recovery_(i].CRC, sizeof (unsigned short)); 6 
K +=" sizeof (unsigned" short) ; ' ~ 



memcpy{ (unsigned char *)&bufferl[ k ], (unsigned char *)&Prote 
ctor . recovery_ [i] . buffer (0 J , PROTBCTBD_BUPPBR SIZE) 
Jc += PROTECTED_BUFFER_S I ZE ; ~ 

for (i=0; i< (unsigned) {VAR_NON_CONSECUTIVE_N0 * VAR PROTECTED BU 

{ 

merncpy( (unsigned char *)&bufferl[ k ], (unsigned char *)&Prote 
ctor.SubSectorCrcIi), sizeof (unsigned short)); ^rote 
k += sizeof (unsigned short); 

EncodeBuf f er (k, buf f erl , buf f er2 , &i) ; 
putw(k, Fl); putw(i, Fl); 
. if (f write (buff er2, 1, i f Fl) != i> return 1; 

else 

{ ' 

if ( (f write ( (unsigned short*) SProtector .n subsectors, l sizeof f 
unsigned short), Fl)) I = sizeof (unsigned short)) return 1 ' ( 

if ((fwrxtef (unsigned int *) SProtector.n buffer size, l sizeof f 
unsigned int ), Fl)) != sizeof (unsigned int )) return i; 

for(i=0; i< VAR_NON_CONSECDTIVE_NO ; i++) 
i 2e o^ ( i fWr i^ ( i StrUCt DataRec °very *)&Protector. recovery [i] , i, 3 
Jurn i ; SCOVery) ' F1)> J = 8i2e °f (struct DataRelovery)) re 

FFBR°Sdw°i + ^ (UDSi9ned) (VAR_NON_CONSECUTIVB_NO * VAR_PROTECTETMBU 
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if ((f write ((unsigned short *)&Protector suhw^ r. r-i 
izeof (unsigned short) Pin i -4 '^T C8c r or ' SUM «ctorCrcCi] , 1, s 
^ ig nea snort), Pi)) •= s 1Z eof (unsigned short)) return i ; 

return 0; 

} 

int ReadProtectstructurefFILB *ff, char read) 
{unsigned int i, k=0; J 

unsigned char bufferl [10240] ; 

unsigned char buf fer2 [10240J ; ; 

if (COMPRESS_RBCOVERY_RBCORD) 
k = getw(Fl); i = getw(Fi). 

if(fread(buffer2, l~irWri^rrS&2H T" ~ 
DecodeBuffer(k, buffer2, bufferl, &i) - ' 
k =0; ' 

k += sizeof (unsigned short); 

memcpy( (unsigned char *) ^Protector n hnffor , 
*)&buf£erl[ k Bi,-eo£(uLigS Sn? - Mf (unsigned char 

k += sizeof (unsigned int) ; 

for(i=0; i< VAR_NON_CONSEC0TIVE_NO; i++) 
k += sizeof (unsigned short); 

memcpy ((unsigned char *) tProtector. recovery [il buffer- fni / 
signed char p *>^ufferl[ k ], PROTBCTED^BOFFBR £i£ 101 ' (Un 

k += PROTECTEED_BUFFER_SIZE ; ~ 

k sizeof (unsigned short); 

} 

else 
{ 

if ( (f read ( (unsigned short* ) SProtector n aubsertorq i 
nsign ed short), FF) ) s i zeof {unsigned ^ •»«*(» 
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if ({f read ((unsigned int *) fiProtector.n buffer size, 1 sizeof r„ 
nsignedint ), pp)) sizeof (unsigned int )) "retm 1- ( 

for(i=0; i< VAR_NON_CONSECOTI VE_NO ; i++) 

if ((f read ({struct DataRecovery *) fiProtector. recovery m i a 
etur^ f rU ° t DataRecover y ) • FF >> l = sizeof (struct DataRecovery))' r 

PPER O Sdn 0 i++) (Un3i9ned) « VAR - N °N_CONSECUTIVE_NO * VAR_PROTECTED_BU 

if ((fread( (unsigned short *) tProtector.SubSectorCrcIi] l *H 
zeof (unsigned short), FP) ) != sizeof (unsigned short)) return' 1, 

--3*^)*^^ * VAR_PROTECTBD 

return 0; 

) 

void ComputeDataRecoveryRecord(PILE *FF) 

unsigned int i, j, totalsize = 0, size=0, p, n, k = 0; 

unsigned int buffer_index = 0; 

unsigned short SubSectorCRC; 

unsigned int Index [NON_CONSECDTIVE NO] ; 

memset( (unsigned char *)&lndex, 0, sizeof (Index) ) ; 
memset ((unsigned char *)&ReadIn, 0, sizeof (Readln) ) ; 
SectorsNo=0; 

Printf (« Computing data recovery record, please wait ■ » » 3 

) . . # • * • j J 

* 

for(i=0;;i++) 

if ( (i % (VaR_PROTECTBD_BUFPER_NO * VAR NON CONSECUTIVE NO) == 0 
) && i) — 

{ 

if(SectorsNo % 50 == 0) printf {".•)/ 
for(p=0; p < VAR_NON_CONSBCUTIVE_NO ; p++) 

ER SIZE - ) , me,nSet{(unsi 9 ned *)&X0R_Rez[p), 0, VAR_PROTECTED_BUPF 

^ r , ^ memc Py ( Signed char *) &XOR_Rez [p] , (unsigned char *)&(Re 
adln [p] . Date [0) . buffer [0] ) VAR_PR0TECTED_BUFFER SIZE) ; 
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for(j=0; j < VAR_PROTBCTBD_BUPFBR_SIZB; j++) 

XOR_Rez [p] [ j ] A = Readln [p] .Date [k] . buffer [ j J ; 

memset ( (unsigned char *) & (Protector/* [SectorsNo] */ .recover 
y_[pj .buf fer [0] ) , 0, VAR_PROTECTED_BUFFER_SIZB) ; 

memcpy( (unsigned char *)&(Protector/* [SectorsNo] */. recover 
y_[p] .buffer [0] ) , (unsigned char *) &XOR_Rez [p] , VAR_PROTECTED BUFFK 
R_SIZB) ; 

local_short_crc ( (unsigned char*) & (Protector/* [SectorsNo] * / 
.recovery_[p] .buffer [0] ) , VAR_PROTECTED_BUFFER_SIZE , &SubSectorCRC) 

t 

Protector/* [SectorsNo] */ . recovery_ [p] . CRC = SubSectorCRC; 

for(n=0, k=0; k < VAR_PROTEC*TED_BUFFER_NO ; k++) " " " "•" 

for(p=0; p < VAR_NON_CONSECOTIVE_NO; p++> 

Protector/* [SectorsNo] */.SubSectorCrc [n++] =. Readln [d] Da 
tetkJ.CRC; * 

Protector/* [SectorsNo] */ .n_subsectors = (unsigned short) (VAR 
JPROTECTED_BUFFER_NO * VAR_N0N_CONSBC0TIVB_NO) ; 

Protector/* [SectorsNo] */ .njbuffer.size = size; 

SectorsNo++ ; 

if (WriteCorrectionTable(FF, 0)) break; 
i = size = buf fer_index =0; 

memset ( (unsigned char *)&Index, 0, sizeof (Index) ) ; 
memset ( (unsigned char *)&ReadIn, 0, sizeof (Readln) ) ; 

memset ( (unsigned char *)&Table, 0, VAR_PROTECTEDJBUFFER SIZB) - 
n = fread ((unsigned char *)&Table, l,~totalsize + VAR PROTECTE 
D_BUFFER_SIZB >= FLen - DATA_RECOVERY_INDEX ? VAR_PROTE CTBD BUFFER 
SIZB - (totalsize + VAR_PROTBCTKD_BUFFER_SIZE - (FLen - DATA RECOVE 
RY_INDRX) ) : VAR_PROTBCTED_BDFFBR_S IZE , FF) ; ~ 
size += n; 

totaXsize += n; // don't read from recovery record, too U) 

local_short_crc( (unsigned char*) Table, VAR PROTECTED BUFFER SI7 
B„ SSubSectorCRC) ; ~ ~ - 

memcpy( (unsigned char *)& (Readln [buffer index] .Date [Index [buff e 
r index]] .buffer [0]), (unsigned char *)&Table, VAR_PROTECTED BUFFER 

Readln [buf fer_index]. Date [ Index [buffer index] ] . CRC = SubSector 
CRC; ~~ 
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Index [buf f er_index] ++ ; 

buffer_index = (bu£fer_index + 1) % VAR_N0NC0NSECUTIVE_NO; 

m J^j { {D != VAR_PROTECTED BUFFER S IZE) && ! ( (i % (VAR PROTECTED 
_BUFFER_NO * VAR_NON_CONSECUTIVE_NO) == 0) && i) ) ~ ECTED 

^ || (totalsize >= FLen - DATA_RECOVBRY_INDBX) ) 

for(p=0; p < VAR_NON_CONSECUTIVE_NO ; p++) 

FER_ S rZE); meMet((mSi9ned Char * )&X ° R - ReZlPJ ' °' VAR_PROTECTED_BUF 

raemcpy( (unsigned char *)&XOR Rez[p], (unsigned char *)tfp 
eadlntp] .Date[0] .buffer [0] ) , VAR_PROTECIED_BDFFER^SIZ^^; 

for(k=l; k~< Index ip]/*VAR^ROTBCT^ 
for(j=0; j < VAR_PROTECTED_BUFFER_SIZE ; j++) 

XOR_Rez[p] [j] Readln[p] .Date[k] .buffer [j] ; 

meinset( (unsigned char *)& (Protector/* [SectorsNo] */ recove 
ry_(p].buffer[0)), 0, VAR_PROTECTBD_BUFFER_SIZE) i, ° rSN ° J '' recwe 

memcpy( (unsigned char *)& (Protector/* [SectorsNo] */ recave 
Sli?^; ert01) ' *)^OR_ Rez[p] ; VAR.PRoScTED!^ 

local_short_crc ( (unsigned char*) & (Protector/* [SectorsNol * 
/.recovery_[p] .buf fer [0] ) , VAR_PROTECTED_BUFFER_SIZE , & SuDSectorSc 

Protector/* [SectorsNo] */.recovery_ip] .CRC - SubSectorCRC; 

for(n=0, k=0; k < VAR_PROTECTED_BUFFER_NO ; k++) 
for(p=0; p < VAR_NON_CONSBCUTrVB_NO; p++) 

Datelk].CRCr 0teCt0r/ * StSeCt0rSNOlV ' S ^ SeCt °^ Ctn++ ^ = Read ^CPl- 

n==0; for(p=0; p < VAR_NON_CONSBCUTIVB_NO; P++ ) n + =Index[p] , 
Protector/*s [SectorsNo] */.n_subsectori = n- 
Protector/*s [SectorsNo] */.n_buf fer size = size; 
WriteCorrectionTable (FF, 1) ; 
SectorsNo++ ,- 
break; 

} 

} 

} 

int ReadCorrectionTable(FlLE *FF, unsigned int FSize) 
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fseek(FF, WhereData, SEEKjSET) ; 

if (ReadProtectStructure(FF, WhereData == FLen + DATA RECOVERY IND 
EX)) return 1; *""* ~ 

WhereData « ftell(FF); 

fseek(FF, WhereFile, SEBKJSET) ; 
return 0; 

} 

int WriteCorrectionTable (FILB *FF, char flush) 

WhereFile = ftell(Fi); 
fseek(Fl, WhereData, SEEK_SET) ; 
WriteProtectStructure(FF, l) ; 



if (WhereFile >~ FLen) return 1; 

WhereData = ftell(Fl); 
fseek(Fl, WhereFile, SEEK_SET) ; 
return 0; 

} 

void DeleteHeader (FILE *PP) 
{ 

rewind (FF); 

ARH_H._recovery_Filesize = 0; 
ARH_H._recovery_Method =0; 
ARH_H._recovery_Compressed « 0; 

if (ZipCloaking) fseek(FF; sizeof (ZIP_H) + ZIP_H.f ilenamel, SEEKS 
BT) ; — 

//if (fwrite(&ARH_H, 1, sizeof (ARH H) , FF) !=* sizeof (ARH H) ) Erro 
r(7, "»); ~ r 

if (FWritej^jIeader(&ARH_H, FF) ) Error(7, »«); // rewritten, has 
a 4 byte CRC built in I ; 

} 

int WipeCorrectionTables (FILE *FF) 
{ unsigned int trunc; 

. Printft" Scanning for data recoveify records, please wait" 0 
*, 3); 

trunc = ARH_H._recovery_Filesize; 
DeleteHeader (FF) ; 
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Printf{" Removing recovery records . ■ "# 2); 
_chsize(fileno(FF), trunc) ; // now truncate the file PP {fi> to 
the requested file size I 
return 0; 

> 

int CheckDataRecovery(FILE *FF) 

unsigned short CRC1, i, f, k2 = 0, jl = o, pp=0; 

unsigned char DetectionTable [ PROTECTED_BUFFER_SIZE ], trap [30] ; 

Sectoros = SectorsK = SectorsBadNo = SectorsRepairedNo = o- 
for( ;? pp++) 

{_. 

f = ReadCorrectionTable(Fl, . FLen) ,- 
for(i=0; i < VAR_NON_CONSECDTIVE_NO; i++) 

memcpy( (unsigned char *) DetectionTable, (unsigned char*)&(Pr 
otector.recovery_[i] . buffer [0] ) , VAR_PROTECTED_BUFFER_SIZE) ; 

local_short_crc( (unsigned char *) DetectionTable, VAr' PROTECT 
BD_BUFFER_SIZB, %CRC1) ; - 

sprintf( (char*) trap, " %02d:%02d », pp, i) ; 

if ((unsigned short) CRC1 == (unsigned short) Protector .recover 

y lij • crc) 

{ 

• if(((jl++) % 2 mm 0) && (k2 == 0)) Printf(».«, »», 3). 

else 
{ 

Printf ("Recovery record », • », 3); Printf ( (char*) trap, - - 
, 11); Printf{» has failed CRC", »\n», 3),- 

k2++; . 

} 

} 

if(f) break,- 

} 

sprintf( (char*) trap, " %d », k2); 

Printf(k2 == 0 ? » All Ok! ■ : (char*) trap, » », 2) ; 

Printf (k2 == 0 ? " ■ : » bad recovery records detected", »!», 2); 

return 0; 

} 
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gned int Size, unsigned short *errorIndex) // returns the subsector 
dameged I 

{ 

unsigned int i, k=0, errors = 0; 
unsigned short CRC1; 

unsigned char DetectionTable [ PROTECTBDJBUPFER_SIZE ] ; 

for(i=0; i < Protec tor. n_subsec tors; i++) 
{ r 
memcpy( (unsigned char *) DetectionTable, (unsigned char *)&Table 
[(i*VAR_PROTECTBD_BUFFBR_SIZB)] / VAR_PROTECTED_B^JFFER_SIZB) ; 

local_short_crc( (unsigned char *) DetectionTable, VAR PROTECTED 
BUFFKR_SIZE, &CRC1) ; ~ - 

if (Protector. SubSectorCrc [i] != CRC1) 

{ ....... 

errors =1? 
errorlndex [i] = 1; 

} 

if (errors ==0) 
{ 

sprintf { (char *)Tmp_, "%2d:%02d [%X...%X]», SectorI,i, Sec 
torI*Protector/*s[SectorI]*7.n_J>uffer_size + i * PROTECTED BUFFER SI 
ZE, SectorI*Protector/*s[SectorI]*/.n buffer size + i*VAR PROTECTS 
D_BUFFER_SIZB) ; / ~ 

PrintfC Sector", f », 3) ; 

Printf (Tmp_, » », H) ; 
Printf ( ■ has CRC Ok n , »!«, 3) ; 

i f ( i *VAR_PROTECTED_BUFFfiR_SI ZE >= Size) break; 
return (errors) ; 

} . ; . 

void Repair (unsigned char ; *Table, unsigned int bad subsector, unsia 
ned int TableSize) • ~ ' s 

{ 

char OkData [ PROTECTED_BUFFER__S I ZE] ; 

char Data [PROTECTEDJBUFFBR_NO] [PROTBCTED_BUFFERjSIZE] ; 

unsigned int i, j, k, non_consecutive; 
unsigned short "KCRC; 

non_consecutive = bad_subsector % VAR_NON_CONSECOTrVE_NO ; 

/* primul X = bad_subsectbr % VAR_NON_CONSECUTIVB NO; 
X 
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X 
X 



ctor] 



Mega Sector 

X 
X 
X 
X 
X 



X 
X 
X 



++++++++ 
++++++++ 
++++++++ 
++++++++ 
++++++++ 

++++++++ 
++++++++ 
++++++++ 



<- Subsector o 
<- Subs ec tor 1 
<- 



< BadSector [this is the damaged a e 



*/ 



XOR_Rez equ : X0R_Rez [i] Table [i] ; 



for(i=non_consecutive, j«a ; i < Protector/*s [NodelD] */ *n subsecto 
rs; l+=VAR_NON_CONSKCUTIVE_NO r j++) ~ 

memset (Data [ j ] , 0 , VARJPR0TECTEDJ3UFFBR_SIZE) ; 
if (i*VAR_PROTECTKD_BUFPBRj3IZE < TableSize) 

mh» m !^^ ((UnSigned ° har •J^taHlt (unsigned char *)&Table[ 
(X*VAR_PR0TBCTBD_BUFPER_SI2E) ] , VARJPROTECTED_BUFFER_SIZE) * 

unsigned char XORez [PROTECTEDJ3UFFER_SIZE] ; . 
memcpyf (unsigned char*)XORez, (unsigned char*) & (Protector Recover 
y_[non_consecutive] . buffer [0] ) , VAR_PROTECTED_BUFFBR SIZE) • 
memset (OkData, 0, sizeof (OkData) ) ; ' 
for(k=0; k < VAR_PROTECTED_BUFFER_SIZE; k++) 

for(i=0; i < j; i++) 

if(i != (bad__subsector / VAR_NON_CONSECUTIVE NO)) 
OkData [k] A = Data[i] [k] ; 

// bad_subsector = 11 ==> 

// X- 5 

II X = 11 <- dar din Data = 1 = (1 



1 / 6) 



// 
// 



X = 17 



} 

OkData [k] XORez [k] ; 
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// compute a short crc 

local_short_crc ( (unsigned char *)0kData, VAR_PROTECTED_BUFFER SIZ 
E f &KCRC); //pointer to bytes to pump through, jaumber of bytes~in 
. s[] */ 

if (Protector/*s [NodelD] */ . SubSectorCrc [bad_subsector] == KCRC) 

// recopy the affected sub-sector, but only if okay, cause othe 
rwise, all buffer long 

■ / / might be erased because "of a single char wrong 

meracpy( (unsigned char *)&Table[(bad_subsector*VAR PROTECTED BUP 
FER_SIZE)], " ~ 

(unsigned char *)&OkData, VAR_PROTECTED_BUFFER_SIZE) ; 
Print"(» ::*.»;'"" **; 2; ""'recovered i", * », 14, " n , " » 14 » 
% ■ », 14, -1); 

SectorsRepairedNo ++; 

} 

else Print ( n ■ », 2, "unable to recover ■ , "!», 4, w » 

" 4, » », " «, 0, -1),- 
} 

void Repair () 
{ int A « 0; 

unsigned short Errorlndex [ NON_CONSECUTIVE NO * PROTECTED BUFFER 
NO ]; " ~ 

Printf (" Searching for bad sectors ... ■ , » n , 2) ; 
Sectoros = SectorsK » SectorsBadNo = SectorsRepairedNo = 0; 

for(;;) 
{ 

if (ReadCorrectionTable(Fl, FLen)) break; 

memset (Errorlndex, 0 , sizeof (Errorlndex) ) ; 

memset ( (unsigned char *)&Final, 0, sizeof (Final) ) ; 

fread ((unsigned char *)&Final, 1, Protector. njbufferjsize, Fl) 

WhereFile = ftell(Fl); 

if (DamageDetected( Final, SectorsK, Protect or. njbuf f er size, Err 
or Index) ) 

{ 

for (int ko=0; ko < Protector. n subsectors; ko++) 

{ ... 

if (Errorlndex [ko] == l) 

{ 
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SectorsBadNo++ ; 

sprintf ({char *)Tmp_, "%d:%d [%X...%X]», SectorsK, ko 
, Protector. ii_buffer_size*SectorsK + ko*PROT£CTEDJBUFFER_SIZE, Pr 
otector.n_buffer_size*SectorsK + (ko+1) *VAR_PROTECTED_BUFFER_SIZE) ; 
Printf ( n Sector » 3); 

Printf (Tmp_, ■ », 11); 

Printf {" has failed CRC n , n », 3); 

Repair (Pinal, ko, ^Protector. njbuffer_size) ; 

else 
{ 

sprintf ((char *)Tmp_, "%d:%d [%X...%X]«, SectorsK, ko 
, Protector. njDuffer^s~ize*SectorsK + ko* PR0TBCTEDJ3UFFER_S I ZE , Pr 
o'tector.'n_buffer_size*SectorsK +. (kd+1) *YAR_PROTECTED_BUPPER_SIZE) ; 
Printf ( tt Sector n w , 3) ; 

Printf (Tmp_, » °, 11); 

Printf {" has CRC Okl °, ■ 3) ; 

} 

} 

fwrite (Final, 1, Protector .n_buf f er_size, F2) ; 

} 

else f write (Final, 1,- Protector. njbuf f er_size, F2) ; 
SectorsK++; 

} r\ 

Printf ( n Done detecting bad sectors "l", 3); 

if (SectorsK == 0) { Printf (" There was an error : could not rea 
d the recovery record, aborting repairing", "l", 12); return; } 

if (SectorsBadNo « 0) ' Printf (» No Sectors is damaged, aborting 
repairing", M n , 3); • ' 

else 

{ . K • . 

char Tl [100] , T2 [100] ; : T3 [100] ; 

sprintf (Tl, n %d n , SectorsBadNo); sprintf (T2, °%d B , s 

ectorsRepairedNo) ; . 

sprintf (T3, »%d%c n , (SectorsRepairedNo * 100) / SectorsBadN 
o, »%'); 

sprintf (Tmp_, »%&», (SectorsRepairedNo + 1) / 2) ; 
Printf (Tl, ■ », li) ; 

Printf ( » damaged subsec tor (s) reported, », n », 3) ; 

Printf (T2, » li) ; 

Printf ( n repaired ■ , ■ [ n , 3 ) ; 
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Printf (Tmp_, " ", n) ; 

Printf (» Kbytes] ■ », 3); 

Printf (T3, »\n», 11); 

Printf (» successfully", "!", 3); 

DeleteHeader (F2) ; 
Fclose(F2 / 0, 0) ; 

_chsize(fileno(F2), f f trunc) ;: // ensure the file has the desired 
size 1 

} 

void InitializeProtect ion (unsigned char met, unsigned int size, cha 
r action) 

{ ...... ..... 

switch (action) 
{ 

case 2: Printf (" Testing recovery records", ».», 3); return; b 
reak; 

case 1: Printf (» Protecting using" , ■ », 3); break; 
case 0: Printf (" Recovering using", » ", 3); break; 

//DATA__RECOVBRY^INDEX = ZipCloaking ? . * " 

// sizeof (ARH_H) + sizeof (ZIP_H) + ZIP H;fil 

enamel *~ 

// : 0; / / sizeof (ARH_H) ; //6 -> that extra h 

eader 

WhereFile = 0;//DATA_RBCOVBRY__INDBX; 

switch ( (metoda = met)) 
{ 

case 0: VAR_NON_CONSBCUTIVEJKTO = 3; 

VAR_PROTECTKD_BUFFER_NO = 5; 
VAR_PROTECTBD_BUFFER_SIZE =» 512; 
Printf (» 0 level protection", ".", 11);//, n [", 2, "3 
out of 5", 2, »] ! », 2); 
break; 

case 1: VARJNON_CONSECUTIVB_NO = 5; 

VAR_PROTECTED_BUFFER_NO = 7; 
VARJ?ROTECTED_BUFFER_SIZE = 512; 

Printf (» 1st level protection", ».", 11);//, "[", 2 
"5 out of 7", 2, »] ! », 2); 
break; 



98 



WO 01/50612 



PCT/US01/00424 



Recovery 



VAR_PROTB CTED_JBUFFER__S I ZE = 512; 

Printf(« 2nd level protection", " * 11)*//. » r» o 
"7 out of 11% 2, »] ! », 2); ' ' 

break; 

case 3: VAR_NON_CONSECDTIVE_NO » 11; 

VAR_PROTECTED_BUFPER_NO = 21; 
VAR_ PROTECTED _BUFFER_SIZE = 512; 

Printf(» 3rd level protection", " « 11) •//, n r« 2 
"11 out of 21", 2 f »] ! «, 2);r ' 
break; 

} 

} 
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/*********************** ******************************************* 
*********** 
* 

* 

* The very SOLID stuff xtremly useful procedures 



* 

From Xtreme 106 (DIiL) package by Sabin, Belu (c) 1999 



* 

****************************************************************** 
***********/ 

#pragma pack (1) 

#include <io.h> 
#include <stdio.h> 
#include <string.h> 
Sinclude <conio.h> 
#include <direct.h> 
#include <malloc.h> 
Sinclude <fcntl.h> 
#include <sys/stat.h> 
ftinclude <windows.h> 

#include "crc.h" 

#include "util.h" 

#include n solid.h" 

#include "trees.!! 11 

#include n markoy.h n 

#include w def late.h" 

#include n console. li n 

#pragma pack (1) 
#include * exports. h n 
#include "zipheads.h" 

#include n c : \progra-l\micros~2\myproj -l\xtremeall\xconsole\interf .h 



#pragma pack (1) 

// it must have the pragma pack 1 here : . . . 

declspec( dllexport ) int GetSolidArchiveFileList (char *archive_n 

ame, struct XConsoleLista *archive_name_list) ; 
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SolidFileType *SolidArray = NULL; 
SolidFileType *SolidArray2 « NULL; 

int SolidList = 0, Default = 13; 

unsigned int Solid_ALLOCATED = 3000; 

unsigned long TotalSolidSize; 

unsigned int SolidK « 0, SolidN = 0, Solid_CRC; 

extern struct TableData conf iguration_table [6] ; 

int SolidlnitO 
{ 

if (SolidArray == NULL) SolidArray = (struct SolidFileType *)ma 
Hoc (sizeof (struct SolidFileType) *Solid_ALLOCATED)-; 
SolidJZRC - INIT_CRC_VALUE ; . 
return 0; 

} 

int cdecl Sol idCompare (const void *a, const void *b) 

{ 

char Namel [J4AX_PATH] ; 
char Name2 [_MAX_PATH] ; 

if ( ! ( (struct SolidFileType *) a) ->ext [0] && ! ( (struct SolidF. 
ileType *)b) ->ext [0] ) 

{ 

strcpy (Namel, ((struct SolidFileType *) a) ->RealName) ; 
if (strchr (Namel , " \\ ' ) ) 

{ 

_splitpath (Namel, NULL, NULL, Namel, NULL) ; 

strcpy (Name2 f ({struct SolidFileType *)b) ->RealName) ; 
if (strchr (Name2, 

{ 

_splitpath(Name2, NULL, NULL, Name2, NULL); 
} 

return stricmp (Namel, Name2) ,- 
} 

else 

if (stricmp (((struct SolidFileType *)a)->ext, ((struct Solid 
FileType *)b) ->ext) == 0) 

{ 

strcpy (Namel, ((struct SolidFileType *) a) ->RealName) ; 
if (strchr (Namel, «\\»)) 
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*> 

strcpy(Name2, ((struct SolidFileType *)b) ->RealNarae) ; 
if (strchr(Name2, »\V)) 
{ 

_splitpath(Name2, NULL, NULL, Name2, NULL) ; 
} 

return stricmp(Namel, Name2) ; 
} 

else return stricnrp{( (struct SolidFileType *)a)->ext, ( (str 
uct SolidFileType *)b)->ext); 

} 

void UpdateSolidArray (unsigned int SolidKa) 
{ 

if (SolidKa > Sol id_ALLOCATED - 10) 
{ 

Sol id_ALLOCATED += 2000; 

SolidArray - (struct SolidFileType *)realloc(SolidArray, 

_jnsize (SolidArray) + (2000 * sizeof(stru 

ct SolidFileType))) ; 

if (SolidArray == NULL) 
{ 

printf ("No memory for registering %d more files", Solid_A 

LLOCATED) ; 

exit(0); 

} 

} 

} 

void Sol idFillTheName (unsigned int J, char *name, unsigned int size 

/ unsigned long time_date, unsigned char atrib) 

{ 

7 char drive [J5AX_DRTVB] ; 
. ; char dir [J4AXJDIR] ; 

char f name [_MAX_FNAME] ; 

char ext [_MAX_EXT] ; 

_splitpath(name, drive, dir, fname/ ext ); 
UpdateSolidArray (J) ; 

memset ( SolidArray [J] . RealName , 0 , JWAXJPATH) ; 
strcpy ( SolidArray [J] . RealName , name); 

SolidArray [J] .size = size; 

SolidArray [J] .time_date - time_date; 
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SolidArray[J] .atrib = atrib; // to compress 

TotalSolidSize += size; 

memset (SolidArray [J] . ext , 0,18); 

if (ext [0]) strncpy (SolidArray [J] .ext, (char *) &ext [1] , 18); 

int Solid_Register_Files (char *Director). 

{ * 
struct _f inddata_t Blocks- 
char TmpDir [_MAX_PATH] , Trap [_MAX_PATH] , fname'- [ MAX PNAME] 

ext [ J4AXJEXT] , Coco [200]; ~ 
char drive [JMAXJDRIVE] , dir [_MAX_DIR] ; 
char f name 2 [_MAX_JFNAME] , ext2 [_MAX_EXT] ; _ 
long "~ bone; * ~ " ~ " 

ComplexSplit (Director, drive, dir, fname, ext); // cred ca acest 
ComplexSplit imi face directoarele cu lower ! I ! 
meraset (Director, 0, sizeof (Director) ) ; 
strcat (Director, drive); 
strcat (Director, dir) ,- 

strcat (Director, »*.*«); // deci nu avem extensie la directoare 
ca de exraplu : XtremeDLL.a06 

strcpy(ext, n .* w ); f * 

if ((Done » _findfirst (Director, &Block) ) == -1L) { Error (12, Di 
rector); return 0; } //no files' 
do{ 

if ((Block, at trib & 0x10) 0x10) 

memset (TmpDir, 0, sizeof (TmpDir) ) ; 

stracpy (TmpDir, Director,. ;strlen (Director) - 3/*strlen(fn 
ame) - strlen(ext) */) ; 

strcat (TmpDir, Block. name) ; 
strcat (TmpDir, n \\») ; 
strcat (TnpDir, fname); 

strcat (TmpDir, ext) ; 
if (strstr (TmpDir, n .\\ n ) == NULL) 

if (Recursiv) 

{ 

strcpy(Trap, TmpDir) ; 
Tmp[strlen(Trap)-3] = 0; 
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sprintf (Coco, w %-36s n , short_str(Tmp, 35)); 
Printf( n Scanning sub-directory *, **, 3) ; 
Printf(Coco, *\x n , 2); 

Solid jRegisterJFiles (TmpDir) ; 

} 

} 

} 

else 

_splitpath (Block. name, NULL, NULL, fname2, ext 2) ; 
if (Verify (fname2, fname, strlen ( fname2 ) , strlen(fname) ) && 
Verify(ext2, ext, strlen( ext2) > strlen( ext))) 

mems Tntpbir f 0, sizeof (TmpDir j ) ; 

strncpy (TmpDir, Director, strlen (Director ) - 3/* *.* str 

len(fname) - strlen (ext) */) ; 

strcat (TmpDir, Block. name); 

if (Block. size) 

SolidFillTheName(SolidN++, TmpDir, Block. size. Block. t 
imejwrite, (unsigned char) Block. attrib) ; // don't register zero len 
gth file! 

} 

} 

} 

}while(_findnext(Done, fcBlock) == 0) ; 

_findclose(Done) ,- 
return 1; 

} 

void SolidExtract(void) 
{ 

int uu » ftell(Fl); 
SolidK = 0; 

raemsetdnFile, 0, JMAX_PATH) ; 
strcpydnFile, SolidArray [0] .RealName) ; 
TotalSum = SolidArray [Sol idK++J .size; 

if((Sterg == 1 | | Actualizes == 1 | j Extrag == 1) && (SolidArra 
y[0] .selected == 1)) writejnelt = 0; 
else "write melt = 1; 
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if (writejnelt) QpenFile(InFile, SolidArray [0] .time_date, Solid 
Array [0] .atrib) ; 
inflate (); 

} 

int SolidMelt(void) 
{ 

SolidlnitO; 

if (Read_Solid_Header() ) return 1; 
SolidExtract ( ) ; 
return 0; 

} 

void Register_File_List (char *FileMask) _ .... 

*{ char File [ _MAX_FNAMEl ;* 

char ext [JflAX_EXT] ; 

char Surs [_MAX_PATH] ; 

memBet(Surs, 0, sizeof (Surs) ) ; 
strcpy(Surs, FileMask) ; 
if (Recursiv) 
{ 

Print ( n Analyzing directory n f " ,n , 3, short_str (FileMask, 49 
2, «\n», 0, »», 0, 

/ memset (File, 0, _MAX_FNAME) ; 

raeraset {ext, 0, _MAX__EXT) ; 
" jsplitpath (FileMask, NULL, NULL, File, ext); 

if (File t0] — 0 || ext[0] ==* 0) 

if (Surs [strlen (Surs) - 1] != , \\' ) strcat (Surs, B \\ n ); 
• strcat(Surs, "*.*»); 

:> 
} ■/ 

else Printf { n Analyzing w , " . . . B , 3) ; 
Solid_Register_Files (Sure) ; 



void Regis ter_Single_File (char *full_f ilename) 

{ 

int fh, result; 
struct _stat buffer; 

if{ (fh = _open(full_filename, _0_RDONLY, _S_IREAD) ) != -1 ) 
{ 
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result « (int) (_filelength(fh) ) ; 
_fstat(fh, (struct _stat *)&buffer) ; 

if (buffer. st_size) // only if size is non zero please I 

SolidFillTheName(SolidN++, full_filename, buf fer.stjsize, bu 
f fer .st_mtirae, 

(unsigned char) (GetFileAttributes (f 

ull_f ilename) ) ) ; 
} 

close (fh); 

} 

} 

void SolidFreezefchar *FileMask). 
{ 

char Surs [_MAX_PATH] ; 
char Theatre [ _J4AX_PATH + _MAX_PATH] ; 
unsigned int ik; 

SolidlnitO; 

SolidK = 1; SolidN « 0; TotalSolidSize « 0; 

memset(Surs f 0 7 sizeof (Surs) ) ; 
strcpy(Surs, FileMask) ; 

.* ■' 

// ' ; 

// The RealName and Archive N&ne strategy is 'xtremely' go 
od. We can basically read from 

// any directory (since we have two different paths in our 
interface), and, that's 

// the most interesting of all, we can even create fake dir 
ectories inside the archive " 

// like the UC2 f s 'Archive directory 1 It will be ixople 

mented in ADD, and then 

// I would like to get rid of that aweful(but usefull, till 
now) SolidArray2. Thank you 

for{ik=0; ik < MyXtrStructure. Ma^irectories; ik++) 

{ * 
memset (Theatre, 0 , sizeof (Theatre) ) ; 

if (MyXtrStructure.Surselelik] .Pathl6r2 ? 

MyXtrStructure . Pathl [0] : 

MyXtrStructure. Path2 [0] ) 

{ 

strcpy (Theatre , (MyXtrStructure . Sursele [ik] . Pa 
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thl0r2 ? 

MyXtrStructure.Pathl : MyXtrStruct 

ure.Path2)); 

CheqkSlash (Theatre) ; // if ( (strlen (Theatre) ) 
&& (Theatre [strlen (Theatre) - 1] != '\V>) strcat (Theatre, "\\"); 

} 

strcat (Theatre/ MyXtrStructure . Sursele [ik] .Name) ; 

if (MyXtrStructure . Sursele [ik] . File) . Register_Singl 
e_File (Theatre) ; // if file size is not zero I • 

else RegisterJFileJList (The 

atre) ; - 

r . ... - - - 

if(Recursiv) Printf (" Directories scanned. 
», »\n\n", 3); 

if(SolidN) 

if(Recursiv) Printf (" Analysing , ..", "\n", 3); 

sprintf(tmp, "%d", SolidN) ; 

Print (" Sorting", » ", 3, tmp, " ", 14 , SolidN > 1 ? »fi 
les ... ■ : "file.", "\n", 3, "", 4, -1) ; 

qsort ( (struct SolidFileType *) SolidArray, (int) SolidN, sizeo 
f (struct SolidFileType) , SolidCoinpare) ; 

Printf (* Freezing solid header n \n ", 3) ; 

if (Write_Archive_Header()) return ; 

if (Write_Solid_Header ( ) ) return; 

sprint f (tmp, ■ 1 %s 1 ■ , short_str ( FileMask /*Sursa [0] .Name*/ , 6 

5)); 

Print(" Freezing files", " ", 3, trap, "\n", 2, »«, "», 0,. 
0, -1) ; 

PackFile (SolidArray [SolidK-1] .RealName, SolidArray [SolidK 

-1] .size) ; 

} 

Write_Solid_CRC () ; 

} 

int TestSolidArchive (void) 
{ 
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• unsigned long CatAre = JE ilelength(_f ileno(Fi) ) ; 
unsigned long Undere =0; 

SolidlnitO; 

if (Read_Solid_Header() ) return 1; 
SolidK = 0; 

raemset (InFile, 0, JMAX_PATH) ; 
' strcpy{ InFile, SolidArray [0] .RealName) ; 
TotalSum = SolidArray [SolidK++] .size; // first file's size 

s 

for(; Read_Block() ==0;) 
{ 

Undere = f tell (Fl) ; 

ratio = IntoarceProcent ^Undere,' CatAre) ; 
sprintf (trap, n %35d.%d%c n , ratio / 10, ratio % 10, '%•); 
Print ( a Testing solid archive", » », 2, Destination, D 3, t 
mp, "\r», .2, -", 0, (ratio / 10)); 

if (restbits > 8) break; 

} 

sprintf (trap, »%-56s n , " ") ; 
if (TestedOk) 

{ : 

: Printf (" Solid archive is Ok l n , M \n a , 2); 
//Print(»», 2, ■»", »«, 3, trap, »\n», 2, »«, 0, -1) ; 

. Printf (■ w , »\n", 2); 
sprintf (tmp, » %d n , SolidN) ; 

Print (trap, n D , 10, ■ files processed, °, n \n", 2, B ", » n , 0, 
nn , 0, -1); 

} 

else 

{. . r 

Printf »\n", 2); 
Printf *{ n Solid archive seeraes to have BAD CRC l», n \n", 2) 

} 

Error (2, "■); 

} 

return 0; 

} 

int UpdateSolidArchive(char *files, char _tojsolid_or_normal) 

char texnporaryFilename [J4AX_PATH] , temp [_MAXJPATH] ; 
unsigned int i, Res = 0, j, ToReplace « 0; 



108 



WO 01/50612 



PCT/US01/00424 



Solid 



if (Read_Archive_Header(l)) { Error ( 11 f »»); return 1; } 
SolidlnitO; 

if (Read_Solid_Header() ) return 1; 

Print( B Scanning for freezed", n 3, files, tt . 2, * l , m , n w 
3, 0, -1); 

PileSelection ( ) ; 

SolidArray2 = (struct SolidFileType *)malloc( (SolidN + 3) * sizeof 
(struct SolidFileType) ) ; 
if (SolidArray2 == NULL) return 1; 

for(i=0, j=0; i < SolidN; i++) 
.{ 

if (SoiidArray[i] .selected == i) 

ToReplace++; // easier, isn't it ? 
else 

{ 

Res++ ; 

memcpy( (unsigned char *) &SolidArray2 , (unsigned char *) 

&SolidArray[i] , sizeof (struct SolidFileType) ) ; 

} } 

sprintf (temp r » %d files will be replaced. % ToReplace) ; 
Printf (temp, u \n", 2); ; ; 

if (ToReplace < SolidN) 
{ 

GetTemporaryDirectory (extractionDestination) ; 

Print ( B Extracting to temporary directory n, » ,n , 3 , . extractionD 
estination, »°, 2, ■ » », " », o, »», o, .-1).; 

SolidExtract () ; • 

} 

Pclose(Pl, 0, 0); Pclose(P2, 0, 0); 

Print (" Deleting previously packed files,", » •», 3, files, ■», 2 

for(i=0; i < SolidN; i++) 
{ 

if (SolidArray [i] . selected) 
{ 

char tmp2 [__MAX_PATH] ; 

sprintf (tmp2, » %-63s" , short_str (SolidArray [i] .RealNam 

e, 63)); 
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Print (tinp2, 2, ■ deleted", n n , 3,"", on , 0, " D , on , 0/ 

-1); 

} 

} 

SolidN » 0; 

for (unsigned int ik=0; ik < MyXtrStructure.MaxDirectories; ik++) 

{ 

memset(temp, 0 ,sizeof (temp)} ; 

strcpy(terap, (MyXtrStructure . Sursele [ik] .PathlOr2 ? 

MyXtrStructure . Pathl : MyXtrStructure . Path2 ) ) ; 

CheckSlash(terap) ; 

strcat (temp, MyXtrStructure . Sursele [ik] .Name) ; 

if (MyXtrStructure • Sursele [ik] . File) Register^Single^File ( temp). ; 

// if file size is not zero! 

else Register_File_List (temp) ; - 

} . • 

// maybe if SolidN == 0 to return 1; 

for(i=0; i < SolidN; i++) SolidArray [i] .selected = 0; 
for(i=0; i < Res; i++) 

{ 

UpdateSolidArray (SolidN) ; 

memcpy ( (unsigned char* ) fcSolidArray [SolidN] , (unsigned char* ) &So 
lidArray2 [i] , sizeof (struct SolidFileType) ) ; 

SolidArray [SolidN] .selected = 2; // files that need extra addi 
tion'l 

SolidN++; 

} 

if (SolidArray2) f ree(SolidArray2) ; 

if (CreateTetnporaryArchive (extractionDestination, temporaryFilename 
) ) return 1 ; 

' SolidRePack (SolidN, extract ionDestinat ion, 1) ; 
Printf( B Deleting temporary files", B ", 3) ; 
for(i=0; i < SolidN; i++) 

{ // please do not delete the line with == 2, cause this will move 
files to archive I 

if (SolidArray [i] .selected 2) _unl ink jpath (SolidArray [i] .RealN 
ame, 1) ; 
} 

Fclose(Fl, 6, 0); Fclose(F2, 0, 0); 
GetCurDir (temp) ; 



110 



WO 01/50612 



PCT/US01/00424 



Solid 



if (strstr (Destination, n :\\") == NULL) strcat (temp. Destination); 
else strcpy(terap, Destination); 

_unlink(temp) ; 

rename (temporary-Filename, temp) ; 
return 0; // everything went okay ! 

} 

int SolidDeleteFiles{char *f) •.- 
{ 

char temp [_MAX_PATH] , temporaryPilename [_MAX_PATH] 
unsigned int i. Res = 0, j; 

SolidlnitO; . _ ^ 

if (Read_Solid_Header() ) return 1; 

for(i=0; i < SolidN; i++) 
{ 

if (SolidArray [i] .selected == 1) Res++; // easier, isn't i 

t ? 
} 

sprintf (temp, n %d file(s) will be deleted. 11 , Res); 

Printf (temp, n \n n , 2) ; 
if (Res ==± 0) return 1; 
if (Res != .SolidN) 
{ 

GetTemporaryDiredtory ( extractionDestinat ion) ; 

Print { D Extracting to tenrporaiy directory * , n 1 n , 3 # extractionD 
estination, ■»", 2, °», " n , 0, " B , nB , 0, -1) ; 
SolidBxtract () ; 

} 

Fclose(Fl, 0, 0); Fclose(F2 f 0, 0); 

PrintC Deleting the requested files, n,n , 3, f r 2, ni » 

», o, 0, -1); 

for(i=0; i < SolidN; i++) 

{ 

if (SolidArray [i] .selected) 

{ . 

char tmp2 [ J1AXJPATH] ; 

sprintf (tmp2, " %-63s" , shortjstr (SolidArray [i] .RealNam 

e, 63)); 

Print(tmp2, nn , 2, B deleted", " n , 3,"", nn , 0, »», »«, 0 ^ 
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-D; 

} 

} 

if (Res != SolidN) 
{ 

SolidArray2= (struct SolidFileType *)raalloc ( (SolidN + 1) * sizeo 
f (struct SolidFileType)); 

if (SolidArray2 == NULL) return 1; 
for(i=0, j=0; i < SolidN; i++) 
{ 

if (SolidArray [i] .selected ==0) 

{ 

raemcpy( (struct SolidFileType *) &SolidArray2 , (struct So 
TidFileType*) tSoiidArray [i] , .sizeof (struct SolidFileType))/ 

} } 

for(i=0; i < j; i++) 
{ 

memcpy( (struct SolidFileType*) SSolidArray [i] , (struct SolidF 
ileType*) &SolidArray2 [i] , sizeof (struct SolidFileType) ) ; 



if (CreateTemporaryAr chive (extractionDe§tination, temporaryFilena 
me) ) return 1; 

SolidRePack(j , extract ionDestinat ion , 0); 

Printf (" Deleting temporary files 0 , n \ii n ; 3); 

for(i=0; i < SolidN; i++) _unlink_path (SolidArray [i] .RealName, 

1) ; 
} 

Fclose(Fl, 0, 0) ; 

if (ZipCloaking) // ???? 
{ 

for(i=0; i < SolidN; i++) . 
{ 

raeracpyf (struct SolidFileType*) fcSolidArray [i] , (struct SolidFi 
leType*) &SolidArray2 [i] , sizeof (struct SolidFileType) ) ; 

Write Solid dRC(); 

} 

Fclose(F2, 0,0); 
/ /Get CurDir (temp) ; 
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//strcatttemp, Destination); // not good anymore 

GetCurDir (temp) ; 

if (strstr (Destination, ":\\") ==» NULL) strcat(temp, Destination); 
else strcpy(temp, Destination); 

_unlink (temp) ; 

if (SolidArray2) free (SolidArray2) ; 
if (Res == SolidN) return 0; 
rename (temporaryFilename, temp) ; 
return 0; // all went okay ! 

} 

void SolidRePack (unsigned int maxim, ch^r *frpmWhere, char ^update) . 

{ • 

char terap' [_MAX_PATH] ; 
unsigned int i; 

SolidN = maxim; SolidK = 1; TotalSolidSize = 0; 

qsort ( (struct SolidFileType *) SolidArray, (int) SolidN, sizeof (str 
uct SolidFileType) , SolidCompare) ; 

if (Write_Archive_Header ( ) ) return; 
if (Write_Solid_Header ( ) ) return; 

PrintfC Repacking files *, « \n» , 3); 

for(i=0; i < SolidN; i++) 

{ 

if((_update == 0 ) || (_update == 1 && SolidArray[i] .selected 
== 2)) 
{ 

memset (terap, 0, _MAX_PATH) ; 
strcpyttemp, fromWhere) ; 
strcat (tenrp, SolidArray [i] .RealNarae) ; 
strcpy (SolidArray [i] .RealName, terap); 

} 

TotalSolidSize += SolidArray [il .size; 

} 

PackFile (SolidArray [SolidK-1] .RealNarae, SolidArray [SolidK- 1] .size) 

; 
} 

int Read_Solid_Header (void) 

{ struct Solid_XTREME_Header SolidXTREME_H; 
unsigned int Sizes = 0, x= sizeof (SolidXTREME^H) , Sin, Sout, X 
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unsigned char *Ukdef ined, *Undefined2; 
unsigned short crcl, crc2, rezult =0; 

if (ZipCloaking) return (Read_ZIPJtf*H_Files () ) ; 

SolidN = getw(Fl) ; 
TotalSolidSize =0; 

sprintf (tmp, B Melting solid header [%d files] ■ , SolidN) ; 
Printf (tmp, B B , 3); 
Ini tializeMarkovStates ( ) ; 

X = (sizeof (struct Solid_XTREMB_Header). * _MAX_PATH). * SolidN; 

memory_request_alloc (unsigned char, Undefined, X) ,- 
memory _request_alloc (unsigned char, Undefined2, X) ; 

if (Undefined NULL || Undefined2 == NULL) return 1; 
memset (Undefined, 0, X) ; 

if (fread(&crcl, sizeof (crcl) , 1, Fl) < 1) Error (6, ■■); 
if (fread(&Sout,- sizeof (Sout) , 1, Fl) < 1) Error(6, »■); 
if (f read (Undefined, 1, Sout, Fl) 1= Sout) Error (6, ""); 
MarkovDecodefSout, Undefined, Undefined2, &Sin) ; 
local_shoft_crc (Unde fined , Sout , &cr c2 ) ; 
if ( (unsign&cl short) crcl (unsigned short) crc2) 

Printf ( " Result : [CRC Ok] », n \n B , 3); 
for (unsigned int i=0; i < SolidN; i++) 
{ 

UpdateSolidArray(i) ; 
// , i£(i % (SolidN / 23 ~= 0 ? 1 : SolidN / 23) == 0) 

Printf (".",; 15); 

memcpy (&SolidXTREME_H, (unsigned char* ) fcUndef ined2 [Sizes] , 

x); 

memset (InFile, 0, JYIAX_PATH) ; 

memcpy( InFile, (unsigned char*) &Undef ined2 [Sizes + x] , Soli 
dXTREME_H._NamLen) ; 

SizeS += x + SolidXTREMB_H * _NamLen ; * 
TotalSolidSize += SolidXTREME_H._SizeUnCom; 
SolidFillTheName(i, InFile, SolidXTREME_H._SizeUnCom, Solid 
XTREMEJI.JTimeJDate, SolidXTKEME_H._Atrib) ; 

rezult = 0; 
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Printf(° Result : [CRC Failed] "\n% 3); 
rezult = 1; 

if (Undef ined2 != NULL) { free(Undef ined2) ; Undefined2 = NULL; } 
if (Undefined != NULL) { f ree.(Undef ined) ; Undefined = NULL; } 
De_Init_Buf () ; // Deinitialize Markov States 

if (rezult — 1) 
{ 

Error ( 6 , ■ Solid_header_ seems _ a_ little . bit damaged . , - . . ». . 

); 

return 1; 

} 

return 0 ; 

} 

int Write_Solid_Header (void) 
{ short ratio; 

unsigned char *Undefined, *Undefined2; 

struct Solid_XTREME_Header Sol idXTREME_H ; 

unsigned int SizeS = 0, x » sizeof (SolidXTREMB_H) , Sout, X; 
unsigned short crc; 

char TmpFile [_MAX_PATH] , ttnpp [300] ; 

if (ZipCloaking) return 0; // no need for another zip header, here 

i 

putw(SolidN, F2); 

InitializeMarkovStatesO; // initialize the Markov model 

X - (sizeof (struct Solid^XTREMB^Header) + _MAXJPATH) * SolidN; 

memory_request_alloc (unsigned char, Undefined, X); 

memory_request_alloc (unsigned char, Undef ined2, X); 

if (Undefined NULL | | Undef ined2 == NULL) return 1; 

meraset (Undefined, 0, X) ; 

for (unsigned int i=0;i<SolidN;i++) 

SolidXTRBME_H._Time_Date = SolidArray [i] .tirae_date ? 
SolidXTREME_H._SizeUnCom « SolidArray [i] /size;. 
SolidXTREME H._Atrib = SolidArray [i] .atrib; 



else 

{ 
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Sol idXTREME_H . _N0T_USED1 - 32; 
Sol idXTREME_H . _NOT_USBD2 =32; 

memset(InFile, 0, _MAX_PATH) ; 
memsetCTmpFile, 0, _MAX_PATH) ; 
strcpy(InFile, SolidArrayCil .RealName) ; 

strcpy(TmpFile, (char *) &InFile [strstr (InFile, »:\\") ? 3 

^^SolidXTREME^.JIaniLen » (strlen(TmpFile) ) ; 

memcpyt (unsigned char*) Undefined [Sizes] , &SolidXTREME_H, x) ; 
memcpyt (unsigned char*) ftUhdef iried[SizeS + x] , TmpFile, SolidX 
TREME_H . _NamLen) ; 

Sizes' += ' x" + SolidXTREMB_H .JNainLen; 

MarkovEncode (SizeS, undefined, Undef ined2 , &Sout) ; 
local short crc (Undef ined2, Sout, fccrc) ; 

if (f write (&crc, sizeof(crc), 1, F2) < 1) Error(5, »"); 

if ( f write (&Sout, sizeof (Sout) , 1, F2) < 1) Error(5, ""); 

if (f write (Undef ined2, 1, Sout, F2) < Sout) Error (5, "») ; 

ratio = mtoarceProcent (Sout, Sizes); 

sprintf (tropp," Solid header freezed l%d.%d%c]», ratio / 10, ratio 
% 10 1 % 1 ) ; 

if (Repack == 0) Printf (tmpp, »\n», 2); 

if (Undef ined2 != NULL) { free (Undef ined2) ; Undef ined2 = NULL; } 

if (Undefined Is NULL) { free (Undefined) ; Undefined = NULL; } 

De_Init_Buf () ; // Deinitialize Markov States 

return 0; 

} 

int Write_Solid_CRC (void) 
{ char T[303 ; 
short ratio; 

ratio = mtoarceProcent (TotalWrit, TotalSolidSize) ; 

sprintf (T, "%3d.%d%c", ratio / 10, ratio % 10, •%•); 

Printf (" Updating solid archive header.", "\n», 3); // for CRC I 

if (ZipCloaking) 

WriteZipHeaders(fcTotalWrit) ; 

Print (" Solid archive ratio"-, » », 3, T, --, 2, •», "", 0, "" 

, 0, -1); 

Printf ( n \n n , »", 0) ; 
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return 0; 

} 

/****************************************************************** 
******************** 

* BEGIN : This function is only for DLL export use only. Do not t 
ry it inside the DLL. 

******************************************************* *********** 
********************/ 

int GetSolidArchiveFileList (char *archive_name, struct XConsoleList 
a *archive_name_list) 

{ . 

int Rez =0; _ 

unsigned int k; 

int ii =* sizeof (struct XConsoleLista) ; 

if ((PI = fopen(archive_name, B rb+ tt )) == NULL) return' 1; 
if (Read_Archive_Header(0)) return 1; // the zero parameter does 
not allow memory allocation ... 
SolidlnitO; 

if (Read_Solid_Header() ) Rez = l; 
Fclose(Fl, 0, :0) ; 

// now for the 0 SolidN-1 will just copy the files and that f s 
all. ; * . 

for(k=0; k<SolidN; k++) 
{ 

memset ( (unsigned char *) & (archive_name_list [kj ) , 0, sizeof (str 
uct XConsoleLista) ) ; 

strcpy (archive_name_list [k] .Name, SolidArray [k] .RealName) ; 
archive_name_list [k] . FSize = SolidArray [k] . size ; 
archive_name_list [kj .DateTime = SolidArray [k] .time_date; 



r.eturn Rez; 

} 

/****************************************************************** 
******************** . . 

* END : This function is only for DLL export use only. Do not tr 
y it inside the DLL. 

****************************************************************** 
********************/ 

int SolidListFiles ; (char *files) 
{ 
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char f ileal [_MAX_PATH] , dirl [_MAX_PATH] , extl [__MAX_PATH] ; 
char f iles2 [_MAX_PATHl , dlr2 [_MAX_PATH] , ext2 [_MAX_PATH] ; 
unsigned int i. Res =0; 

unsigned long compressed_all = 0, uncompressed_all = f ilelength(f i 
leno(Fl)); 

SolidlnitO; 

if (Read_Solid_Header()) return 1; // this function is perfect. It 
f illes up a structured array, ready to be printed out . . . 

sprintf (tntp, " Name %54s %10s %s", "Original", "Compressed", "Rat 
io") ; 

sprintf (tmp2, ■ 

Printf(tmp, *\n", 3); 
Printf(tmp2, "\n", 15); 

Split (files [0] 0 ? «*.*« : files, NULL, dirl, filesl, extl) ; 
for(i=0; i < SolidN; i++) 
{ 

Split (SolidArray[i] .RealName, NULL, dir2, files2, ext2); 

if( Verify (files2, filesl, strlen(f iles2) , str-len(f ilesl) ) & 

& 

Verify <ext2, extl, strlen( ext2), strlen( extl)) & 

& 

( (strstr{dir2, dirl) == dir2 && (Recursiv) ) || 
( (stricmp(dir2, dirl) « 0) && (Recursiv ==0)) II 
files [0] == 0 )) 

{ 

Res++; 

sprintf (tmp, " %-49s", short_str ( SolidArray li] .RealNam 

e, 49) ); 

sprintf (tnrp2, "%10d", SolidArray [il .size) ; t 
compressed_all +» SolidArray [i] . size; 
Printf(tmp, ■ ", 2); 

Printf(tmp2, "\n", 3); 

} 1 

sprintf (tmp2, ,r 

„ ); 

sprintf (tmp, " %d ", Res); 

memset( filesl, 0, sizeof (filesl) ) ,-meraset (files2, 0, sizeof (f iles2) 
) ;memset(dirl, 0, sizeof (dirl) ) ,-memset (dir2, 0, sizeof (dir2) ) ; 
Spr int fBigNutnber (dirl, compressed_all) /sprintf (filesl, ■ %60s ", 
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dirt); 

SprintfBigNuniber(dir2, uncorapressed_all) ;spriritf (f iles2, 9 %10s 
. dir2); 

ratio a IntoarceProcent (uncoirrpressed_all, compressed_all) ; 
sprintf (extl, «%3d.%d%c", ratio/10, ratio%10, ' %' ) ; 

Printf (ttnp2, 15); 

Printf (filesl, BB , 3); // files sizxe uncompressed 

Printf (files2, nB , 3); // file size compressed 

Printf (extl, n \n n , 3); // file* ratio then \n *- 

Printf (trap, »», 10); // 5 

Printf ("file (s) ^n", 3); // files processed! 

return 0; 

} 
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/****************************************************************** 
*********** 



Trees compression/decompression procedures 

Dynamic Markov / .Dynamic Huffman / XXXAri 
* 

From Xtreme 106 (DLL) package by Sabin, Belu (c) 1999 



* 



* 



* 

~ "*" 

* 

***************************************************************** 
***********/ 
#pragma pack (1) 



. ^include 


<stdio.h> 


# include 


<stdio.h> 


#include 


<string.h> 


#include 


"crc.h" 


#include 


"util.h" 


#include 


"huff man. h n 


# include 


■ solid .h° 


#include 


■ trees, h n 


#include 


"markov.h" 


#include 


a console. h D 


# include 


■deflate.h" 


#include 


n Contextual . h n 



struct Huf f_Block Huffman; 

unsigned int CRC, Huf fmanBlockCRC; 
unsigned char maska, flag, restbits; 
unsigned short D_REST_BITS; 

unsigned short bitsjbuf; // Output buffer, bits are inserted s 
tarting at the bottom (least significant 

short * bits_len; . // Number of valid bits in bijouf . A 

11 bits above the last valid bit are 0. 



#define PutW(c) PutC((c » 8) & OxOOff).; \ 
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PutC((c » 0) & OxOOff); \ 

#define GetCO getc(Pl); // if used somewhere else remember thiB 
: TotalWrit — III! 

#define GetW(c) c=0; \ 
c=GetC(); \ 
c«=8; \ 
c|=GetC(); \_. 
TotalWrit-=2; 

// this array is used to get only the number of the required bits. 

static unsigned short BJMASK[] « . . - - 

{ 

0x0000, 0x0001, 0x0003, 0x0007, 
OxOOOf, OxOOlf, 0x003f, 0x007f, 

OxOOff, OxOlff, Ox03ff, 0x07ff, OxOfff, Oxlfff, 0x3fff, 0x7fff, 
Oxffff 

}; 

void Tree_JStart() 
{ 

flag = 0; 
maska = 1; 
restbits » 0; 
BitBufC =0; 

LitBuf C » LenBuf C = DistBuf C = RestBuf CI « RestBuf C2 = DistBuf C 
= 0U; _ 

) 

bitsjcraf = 0; 
bits_len = 0; . 

} 

#def ine MARKOV_TYPB 0 
#define HUFFMftNJTYPE 1 
#define CONTEXTDALJTYPE 2 
#def ine BLOCK_TYPE^CX)MPRBSSION CONTEXTUALJTYPE 

int FrozenBuffer (unsigned int len, unsigned char *Bufferu, char typ 
e_of_block) 

^ if (fwrite(&len, sizeof(len), 1, F2) < 1) Error(3, nn ); 
updcrc ( (unsigned char *)Bufferu, (unsigned int) len, &CRC) ; 

// 
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// We need a call on the function for a better update of the mess 
age 

//in the window, because it just freezes and it's not quite ok 

II 

II 

Print ( w Frosting blocks, please wait ■ 3, ■ * n , 2, »», 
n », 0, **, 0, -1); 

switch ( type_of Jblbck) 
{ 

case HOTFMANJTYPB : EncodeBuff er (len, Bufferu, OutBuf , tout 
count); break; 

case MARKOV JTYPB i m MarkovEncode (len, Buf f eiru , . OutBuf , - &out . 

count) ; break; 

case CONTEXTUALJTYPE : ContextualEncodeBuf f er (len, Bufferu, O 
utBuf, &out count) ; break; 

} 

if (outcount < len) 

^ if (fwrite(fcoutcount, sizeof (outcount) , 1,. F2) < 1) Error (3, " 
") ; 

if "(fwrite (OutBuf, 1, outcount, F2) < outcount) Error (3, ■ 

-); 

TotalWrit += outcount + 2*sizeof (len) ; 

} 

else 

^ if (fwrite(&len, sizeof(len), 1, P2) < 1) Error{3, ■ 

"); 

if (fwrite (Bufferu, 1, len, P2) < len) Error (3, » 

»); 

TotalWrit += len + 2*aizeof (len) ; 

} 

return (outcount < len) ; 

} 

void MeltBuf f er (unsigned int *len, unsigned char *Buf f eru, char Typ 
e, char type_of_block) 

if (freadden, sizeof (*len) , 1, Fl) < 1) Error(4, «»); 

if (fread(&outcount, sizeof (outcount) , 1, Fl) < 1) Error (4, ,,B ); 

if (f read (Bufferu, 1, outcount, Fl) != outcount) Error (4, »■); 
int u= ftell(Fl) ; 



122 



WO 01/50612 PCT/US01/00424 

Trees 



if (outcount > LITBUP + 1000) 

^ Error (4 , "");// access violation here, requesting help 

//it will exit anyway, so you do not have to do an emerg 
ency exit .... 
} 

TotalWrit-= outcount + 2*sizepf (len) ; 
unsigned int last_out = *len; 



if (Type) 

{ : 

switch (type_6f_block) 

^ case HUFFMANJTYPE : DecodeBuf f er (*len, Bufferu, OutBuf, 
Stout count) ; break; 

case MARKOVjryPE : MarkovDecode (*len, Bufferu, OutBuf, 

Stout count) ; break*; 

case CX)NTEXTUAL_TYPE : ContextualDecodeBuf f er (*len, Bufferu 
, OutBuf, fcoutcount) ; break; 

updcrc ( (unsigned char' *) OutBuf, type_pf _block ? outcount : (un 
signed int) last_out, &CRC) ; 

raemcpy (Bufferu, OutBuf / type_of_block ? outcount : last_out) ; 

} 

else 

^ updcrc ( (unsigned char *) Bufferu, (unsigned int) outcount, &CRC) 

;> : f 

void Send_Block(char end_of_b'lock) 

{ . - • 

unsigned int i; 

unsigned long Wherel, Where2; 

int u= ftell(F2); 

if(maska != 1) BitBuf [BitBuf C++] = flag; 
CRC = INIT_CRC_VALUE; 
Wherel = ftell(F2) ; 

TotalWrit+-sizeof (Huff man) / // everything that's in the archive m 
ust be counted I 

if (f write (&Huf fman, . 1, sizeof (Huffman) , F2) != sizeof (Huffman) ) 
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Error{3, »»); 

Huff man. _BlockJFype_0 - FrozenBuffer (BitBufC, BitBuf, BLOCKJP 
YPE_COMPRESSION) ; 

Huff man. _BlockJType_l = FrozenBuf fer (LitBufC, LitBuf, BLOCKJP 
YPE_COMPRESSION) ; 

Huff man. _BlockJFype_2 = FrozenBuf fer (LenBufC, LenBuf, BLOCKJP 
YPE_COMPRESSION) ; 

Huff man ._Block_Type_3 = FrozenBuf fer (DistBufC, DistBuf, BLOCKJP 
YPE_COMPRESSION) ; 

Huffman . _Block_Type_4 « FrozenBuf fer (RestBufC2 / RestBuf 2, BLOCKJT 
YPE_COMPRESSION) ; 

if (D_REST_BITS > 8) 

{ " . ■ 

for (i = 0; i < RestBufCl; i++) sendjbits (RestBuf 1 [i] , (D_RE 

STJBITS - 8) ) ; 

updcrc ( (unsigned char *) RestBuf 1, (unsigned int) RestBuf CI * 2, 
&CRC) ; 
} 

Huffman. _ RestBits = restbits + (end_of_block » 1.? 9 : 0); 
Huff man. _CRC_total =* CRC; 

Where2 » ftell(F2); 
fseek(F2, Wherel, SBEK_SET) ; 

if ( f write (&Huff man , 1, sizeof (Huff man) , F2) != sizeof (Huffman)) 
Error(3, n ") ; 

fseek(F2 / Where2 r SEEK_SET) ; 

bits_flush(); 

TreeJStart () ; 

} 

int Read_Block() 
{ unsigned int i; 

unsigned short Value; 

int u= f tell (Fl) ; 

// it should have been only for the debug procedures 

if (fread(&Huffman, 1, sizeof (Huffman) , Fl) 1= sizeof (Huffman) ) E 
rror(4, ■ ») ; 

restbits = Huffman._RestBits; 
HuffmanBlockCRC = Huff man. _CRC_total; 
CRC = INIT CRC VALUE; 



MeltBuffer(&BitBufC, BitBuf, Huffman. _Block_Type_0 , BLOCK_TYP 
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E_COMPRESSION) ; 

MeltBufferf&LitBufC, LitBuf, Huf fman._BlockJType_l, BLOCK TYP 
E_COMPRESSiON) ; 

MeltBufferf&LenBufC, LenBuf, Huff man. _Block_Type_2 , BLOCKJTYP 
EJZOMPRESSION) ; 

MeltBuffer(&DistBufC, DistBuf, Huff man. JBlockJFype_3 , BLOOKJTYP 
RECOMPRESSION) ; 

MeltBuffer(&RestBufC2, RestBuf 2, Huffman . JBlock_Type_4 , BLOCKJTYP 
RECOMPRESSION) ; 

RestBufCl = RestBufC2 = DistBuf C; 

u= ftell(Fl); 

if (D_RBST BITS > 8) 

GetW(bitsJbuf); 
bits_len =16; 

for (i t* 0; i < RestBufCl; i++) 
{ 

Value = 0; 

get_bits(&Value, (D_REST_BITS - 8), bool(i < RestBufCl - 1)) 

- f 

RestBufl[i] = Value; 

} 

updcrc { (unsigned char *) RestBuf 1, (unsigned int) RestBufCl * 2, 
. &CRC) ; 

} 

else memset ( (unsigned char *) RestBuf 1, 0 r sizeof (RestBuf 1) ) ; 

LitBuf C = LenBuf C = DistBuf C = RestBufCl = RestBuf C2 = DistBuf C 
= 0U; 

U= ftell(Fl); 

if (CRC 1= Huf f manB lockCRC ) 
{ 

if(Testez =*= 0) Error(2, " n ); 
TestedOk = 0; 
return 1; 

} 

if(Testez == 0) PrintfC Melted OK! », "\r", 3).; 
return 0; 

} 

int Tree Encode (int distance, int len) 

{ 

restbits = { (restbits + 1) % 8) ; 
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if (distance) 

{ 

distance — ; 

DistBuf [DistBufC++] = (distance » D_RESTJ3ITS) & OxOOff; 
RestBuf 1 [RestBuf ci] = distance & B_MASK[D_RESTJBITS] ; 
RestBuf 2 [RestBuf C2] = (unsigned char) (RestBuf 1 [RestBuf CI] » 
(D_REST_BITS - 8)); 

RestBuf 1 [RestBuf CI] &= B_MASK [ (D_REST_BITS - 8)]; 
// ex: D_RESTJ3ITS=10 ==> 9_REST_BITS -8=2 
// ==> deplasara cu D_REST_BITS -8 = 2 pentru a obtine primii 
8 biti == alt char! 

RestBuf C1++; RestBuf C2++; 

if (len < 255) LenBuf [LenBuf C++] =len; 

else 

{ LenBuf [LenBuf C++] = (unsigned char) (255); // marker 
LenBuf [LenBuf C++] = (unsigned char) (len) ; 
LenBuf [LenBuf C++] = (unsigned char) ((len » 8) & OxOOff); 

} } 

else 

{ 

flag |= maska; 

LitBuf [LitBuf C++] = len; 

} : 

if ((maska <<= 1) == 0) // deja 8 ? 

{ 

BitBuf [BitBuf C++] = flag; . 
flag = 0; . , 

maska =1; 

} 

if (LitBuf C > LITBUF - 8 | | LenBuf C > LITBUF - 8 j | DistBuf C > LI 
TBUF - 8 | | RestBuf CI > LITBUF - 8 | | BitBuf C > LITBUF - 8) 

i ' 
SendJBlock(O) ; 

) ; 

return 0; 

} 

void TreeJFlushO 
{ 

if (LitBuf C i| LenBuf C || DistBuf C) Send_Bl6ck(l) ; 
Solid_CRC = INIT_CRC_VALUE ; 

updcrc ( (unsigned char *)Fereastra, (unsigned int) string _s tart ing, 
&Solid CRC) ; 

} 

void send_bits (unsigned short value, short length) /* value to sen 
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d , number of bits */ 

^ if (bitsJLen > 16 - length) // let's try with 32 and a real put 
w() . . . 

{ 

bitsjbuf <<= 16 - bitsJLen; 

bitsjauf += value » (length - (16 - bits_len) ) ; 
PutW(bitsJ)uf); 

bitsbuf « (unsigned short) (value & B_MASK[length - (16 - 
bitsJLen) ] ) ; 

bitsJLen +=* length - 16; 

} 

else 

— bitsjauf «= length; //."the easiest way to send is when 

bitsjbuf += value; // the bits number lies within the 
bitsJLen += length; // 16-bit boundaries. 

} . * 

void get Jaits (unsigned short *value, short length, bool ok) /* val 
ue where to get , number of bits, contor */ 
{ 

if (bitsJLen >= length) 

*value = bitsjbuf » (bits_len - length) ; 
if (bitsJLen - length — 0 && ok) 
{ 

GetW(bitsjDuf ) ; 
bits_len = 16; 

} 

else 

{ 

bitsjbuf = bitsjbuf & B_MASK[bits_len -length] ; // 000 0 
00 0 | 000 001 1 | 00 

bits_len -= length ; 

} 

} 

else 

{ 

* value =* bitsjbuf ; 

GetW (bitsjbuf ); 

*value «= length - bits_len; 

*value |= bitsjbuf » (16 - (length - bitsJLen) ) ; 
bits_len = 16 - (length - bitsJLen) ; 

bits buf = bitsjDuf & B_MASK[bits_len] ; // 000 000 0 | 000 
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001 1 | 00 
} 

} 

// Send the rest of the word, when the compression ends and there i 
s 

// no other way to fill it up. 

void bitsJE iush (void) 
{ 

// strange but first this resolved a bug, then created others I E ! 
// if (bits_JLen) // don't waste 2 byte if there is nothing to put 

I 

//the same condition as with the other bits : if (bits_len) is not 
enough ! 

if (D_REST_JBITS > 8) 
{ 

bits_buf <<= (unsigned short) (16 - bits_len) ; // f 

ill it till 

PutW(bits_buf ) ; 

} - 

} 
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^****************************************************************** 
*********** 
* 

* 

* Non solid stuff but still useful procedures 
* 

* 

* 

* From Xtreme 106 (DLL) package by Sabin, Belu (c) 1999 
* 

* 

* 

*************************************************** 
***********/ 
#pragma pack (i) 

#include <io.h> 
tfinclude <stdio.h> 
#include <string.h> 
#include <conio.h> 
#include <memory.h> 
#include <string.h> 

#include <dos.h> 
#include <direct.h> 

#include "util.h" 
#include » trees. h n 
#include "solid. h M 
^include "markov.h" 
#include "deflate.h" 
# include n console. h n 
#include "nonsolid. h* 

» 

*•. 

int WriteJPake_Header(void) // for non solid operations 
{char TmpFil [_MAX_PATH] ; . 

headerjpos =ftell(F2)? 

strcpy(TtnpFil, (char *)&InFiletstrstr(InFile, n :\\ n ) ? 3 : 0] ) ; 
XTREME_H._NaniLen = strlen(TrapFil) ; 

if (f write (&XTREMEJI, 1, sizeof (XTREMEJI) , F2) 1= sizeof (XTREMB_H 
) || fwrite(TmpFil, 1, XTREMEJI . _NamLen , F2) != XTREMB_H. JJamLen) 

{ 

Error (7, ,,n ); 
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return 1; 

} 

return 0; 

> 

int Write_Real_Header (FILE *F) 
{ 

rewind (F); 

fseek (F, header_pos, SEEK^SET) ; 

XTREMB_H ._SizeUnCom = Total Sum; 
XTREMB_H-_Time =0; 
XTREME_H._Date =0/ 

XTREME_H._FileCRC = 0; 

'* " XTREME_H . _ Table TaBleindeX; 

XTREME_H._NextFile = TotalWrit + sizeof (XTREME_H) + XTREME_H._ 
NamLen; 

fwrite(&XTREME_H, 1, sizeof (XTREME_H) , F) ; 
fseek (F, OL, SEEK_END) ; 
return 0; 

} 



void PackFile (char *name, unsigned int size) 
{ char TmpFile [_MAX_PATH] ; 
unsigned long verif; 

memset (TmpFile, 0, JMAX_PAT£) ; 
strcpy (TmpFile, name); 

strcpydnFile, TrapFile); 
if(Solida =■= 0) WriteJFake_Header() ; 
TotalRead = TotalWrit = 0; 
TotalSum = size; 

if (Repack « 0 || Solida == 0) ReadjustTables () ; //TotalSum 

if((Fl = f open (TmpFile, n rb n )) « NULL ) Error (0, TrapFile); 
else 

verif = JEilelength(fileno(Fl)) ; 

if (verif != size) Error (10, B0 ); // file size changed sine 
e scanning ! !l ! 

initialize_engine (5) ; 
deflate () ; 

} 

Fclose(Fl, 0, 0) ; 
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if (Solida == 0) 
{ - 

sprintf (TmpFile, "%-60s n , short_str (InFile, 60)); 

Print (Repack ? n Repacked" : » Freezed", 11 3, TmpFile, n \n n 

/ / I u r r t V, -J./ t 

Write_RealJKeader (F2 ) ; 



void Freeze (char *FileMask, char repack) 

{ , 

Char tmp [_MAX_PATH] ; 
unsigned int i; 

Solidlriit O f SolidN =~0; 
Register_File_List (FileMask) ; 

if (Repack — * Q) 

{ 

Printf(" Scanning complete. "\n", 3); 

sprintf (tmp, "%s ^s'", short_str (FileMask, 56), (Repack ? " Re 
packing files " : n Freezing files ") ) ; 
.Printf (trap, "\n», 2) ; 

h. 

if (SolidN) 

{ ■ . 

"if (repack == 0) Write_Archive_Header () ; 
for(i=0; i < SolidN; i++) 

PackFile(SolidArray[iJ .RealName, SolidArray [i] .siz 

e) ; 



void Me.ltFileO 
{ 

char FileN [ J4AX_PATH] ; 
char tmp [_MAX_PATH] ; 

if (Read_Archive_Header (1) ) { Error (1, ■*); return; } 
TotalRead = Total Writ = 0; 
memset (FileN, 0, _MAX_PATH) ; 

AssumeYes = 0; // once given, does not mean for all the archives, 
nu ? 
if (Solida == 0) 
{ 
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while { I CheckStruct (FileN) ) 
{ 

if (FileN [0]) 
{ 

if (OpenFile (FileN, 0, 32)) // normal attribute 
{ 

raemset (InFile r 0, _MAX_PATH) ; 
strcpydnFile, FileN) ; 
inflate (); 
Fclose(F2, 0, 0); 

} 

} 

memset (FileN, 0, _MAX__PATH) ; 

} 

} 

else 
{ 

int iiu s ftell(Fl); 
SolidMeltO; 

sprintf (tmp, n %d files processed. n , SolidK) ; 
Printf (tmp, "\n n , 10); 

} 

} : 

int TestFrostedFilesO 
{ char FileN [_MAX_PATHJ ; 

unsigned long CatAre = _f ilelength(_fileno(Fl) ) ; 

unsigned long Undere = 0, Errors = 0; 

if (Read_Archive_Header(l) || CatAre ==0) { Error (1, on ); exit(0) 
' } 

metnset (FileN, 0, __MAX_PATH) ; 
if (Solida 0) 
{ 

while ( ! CheckStruct (FileN) ) 
{ 

TestedOk = 1; 
if (FileN [0]) 
{ 

Printf ( w Testing", 0 B ,3); 

Printf (FileN, tt \n w , 2) ; 

for(;ReadJBlock() == 0;) 

{ 

Printf (■ Testing", n », 3),- 

Printf (FileN, »\n ", 2); 
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if (restbits > 8) break; 

} 

sprintf (trap, " %-70s", FileN); 
if (TestedOk) 
{ 

Printf(tmp, » », 2); 
Printf(" OK" , "\n", 3); 

} 

else 

* Printf(tmp, " », 2) ; 

Printf(» failed", " \n", 12); 

Errors++; 

■ - } } : • " ' 

memset (FileN, 0, _MAX_PATH) ; 

else Errors = TestSolidArchive () ; 
return (Errors + 7) ; 

} 

int DeleteNonSolidArchive(char * files) 

^ char f ilesl [_MAX_PATH] , dirl [_MAX_PATH] , extl [_MAX_PATH] ; 
Char files2 [_MAX_PATH] , dir2 [_MAX_PATH] , ext2 [_MAX__PATH] ; 
char temp [_MAX_PATH] , tempfile [_MAXJPATH] ; 
char FileN [_MAX_PATH] ; 
unsigned int c, dels = 0, k; 

memset (FileN, 0, _MAXJPATH) ; 
GetTemporaryDirectory (tempfile) ; 
strcat (tempfile, ."xtremly.tmp") ; 

if ( (F2=f open (tempfile, »wb+")) == NULL) return 1; 

Printf(» Deleting B , " ,n , 3); Printf (files, n \n% 2) ; 
Printft" Creating temporary archive " , Bl " f 3); Printf (tempfile, 
"\n», 2); 

Split(files, NULL, dirl, filesl, extl); 

Printf(» Scanning for packed w , " ,n , 3); Printf (files, »\n n , 2) ; 

> if (Read_Archive_Header(l)) { Error (1, nn ); exit(0); } 
else 

^ //if ((f write (&ARH_H, 1, sizeof (ARH_H) , F2)) 1= sizeof (ARH_H) ) 
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return 1/ // writes the first header 

if (FWrite_ARHJHeader(&ARH_H # F2) ) return 1; // rewritten, has 
a 4 byte CRC built in ! 

} 

while ( I CheckStruct (FileN) ) 
{ 

if (FileN [0] ) 
{ 

Split(FileN, NULL, dir2, files2, ext2) ; 

if (Verify (files2, filesl,- strlen(f iles2) , strlen(f ilesl) ) && 
Verify(ext2, extl, strlen( ext2) , strlen( extl) ) && 

{ (strstr(dir2, dirl) dir2 && (Recursiv - )) || 
(stricnrp(dir2, dirl) == 0 && (Recursiv == 0)) ) ) 

{ • 

Printf (» Deleted- »— " 9 T 2) ; 

Printf (FileN, «\n", 3); // just erase the file by 

skiping it 

SkipToNextFile (Fl) ; 
dels++ ; 

} 

else 
{ 

if ( (f write (&XTREME_H, l f sizeof (XTREME_H) , F2)> 1= sizeof (X 
TRKME_H) ) - return 1 ; 

if ( (fwrite (FileN, 1, XTREME_H._NamLen, F2) ) != XTREMB_H 

.._NamLen) , return 1; 

c « ftell(Fl) ; 

for ( ; ; ) 

{ 

if((k = getc(Fl)) EOF) Error (9, ""); // unexpected END 

-OF-Archive 

putc(k, F2) ; 

if. (c++ >= (header pos + sizeof (ARH H).) - 1) break; 

y • . 

c - ftell(Fl) ; 

} ; . 

} memset (FileN, 0, JMAX_PATH) ; 

} 

Fclose(Fl, 0,0); 
Fclose(F2, 0, 0) ; 

sprintf (temp, " %d file(s) deleted. 1 , dels); 
Printf (temp, n \n w , 2 ); 

Printf {■ Deleting temporary files " a , 2); 
if (dels) 
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{ 

//GetCurDir (temp) ; 
//strcatftemp, Destination); 

GetCurDir (temp) ; 

if (strstr (Destination, B :\\ n ) -« NULL) strcat (temp, Destination) 

else strcpy(temp, Destination) ,- 

_unlink (temp) ; 
rename (tempfile, temp); 

return 0; // archive has just been changed i 

) 

else 

_unlink (tempfile) ; // nothing to replace 
return 1; 

} 

return -1; 

} 

void NonSolidListFiles(char *files) 

{ char f ilesl [_MAX_PATH] , dirl [_MAX_PATH] , extl [_MAXJPATH] ; 
char f iles2 [_MAX_PATH] , dir2 [_MAX_PATH] , ext2 [_MAX_PATH] ; 

char FileN [_MAX_PATH] ; 
unsigned int FileK=0; 

memset (FileN, 0, _MAXJPATH) ; 

sprintf (trap, n Name %55s %10s %s", "Original", "Compressed", "Rat 
io") ; 

sprintf ( ttnp2 , ■ ' 

, "); : 

Printf ( tmp , " \n" , 3 ) ; / . 

Printf(tmp2, "\n", 15); 

Split (files [0] == 0 ? "*.*" : files, NULL, dirl, f ilesl, extl); 
header _pos = 0; 

while ( ! CheckStruct (FileN) ) 
{ 

if (FileN [0]) 
{ 

Split (FileN, NULL, dir2, files2, ext2) ; 
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if ( Verify (files2, filesl, strlen(files2) , strlen(f ileal) ) 

&& . . 

Verify(ext2, exti, strlen( ext2) , strlen( extl) ) 

&& 

((strstr(dir2, dirl) == dir2 && (Recursiv )) || 
(stricmp(dir2, dirl) == 0 (Recursiv ==0)) || fi 

les[0] ==0)) 
{ 

ratio b IntoarceProcent (TotalWrit, TotalRead) ; 
sprintf (tmp, ■ %-48s n , Bhort_str (FileN, 48)); 
sprintf (tmp2, "%10d %10d ^%3d.%d%c", TotalRead, TotalWri 
t, ratio / 10, ratio % 10, •%•);• 

Print (" °, « ",3, tmp, n n , 2, tmp2, "\n n , 3, » n , » 

FileK++; 

} 

.} 

memset (FileN, 0 , sizeof (FileN) ) ; 
SkipToNextFile(Fl) ; 

} 

sprintf (trap2 , n *■ : 

_„ „,. 

sprintf (trap, ■ /%d file (s) . » , FileK) ; 
Printf (tmp2, »\n\ 15); 
Printf (tmp, 10); 

} 

int UpdateNonSolidArchive(char *files, char _to_what_type) 

char f ilesl [_MAX_PATH] , dirl [_MAX_PATH] , extl [_MAX_PATH] ; 
char files2 [__MAX_PATH] , dir2 [_MAX_PATH] , ext2 [_MAX_PATH] ; 
.char temp [J4AX_PATH] , tempfile [_MAX_PATH] ; 
char FileN [_MAXJPATH] ; 
unsigned int c, dels = 0, k; 

memset (FileN, 0, _MAX_PATH) ; 

GetTemporaryDirectory (tempfile) ; 

strcat (tempfile, "xtremly.tmp 0 ) ; 

if ((F2=f open (tempfile, »wb+")) ==» NULL) return I; 

Printf {" Deleting w , n,n , 3); Printf (files, n \n», 2) ; 
Printf (» Creating temporary archive ■ 3); Printf (tempfile, 

n 2); 

ComplexSplit (files, temp, dirl, f ilesl, extl); 
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if (Read_ArcMve_Header(l) ) { Error (1, nB ); return 1; } 

else , 

{ 

//if ((fwrite(&ARH_H, 1, sizeof (ARH_H) , F2).) != sizeof (ARH_H) ) 
return 1/ // writes the first header 

if (FWrite_ARH_Header(&ARH_H, F2) ) return 1; // rewritten, has 
a 4 byte CRC built in! 

} 

Printf (■ Scanning for packed »"*, 3); Printf (files, »\n", 2); 

while ( ! CheckStruct (PileN) ) 
{ 

if (PileN [0]) 
{ 

Split (PileN, NULL; dir2, files2, ext2)>" 

if (Verify (files2, filesl, strlen(f iles2) , strlen(f ilesl) ) && 
Verify(ext2, extl, strlen( ext2) , strlen( extl) ) && 
((strstr(dir2, dirl) «» dir2 && (Recursiv )) || 
(stricmp(dir2, dirl) == 0 && (Recursiv == 0)))) 

{ 

Printf ( n Deleted », » », 2); Printf (PileN, "\n n , 3);// just 
. erase the file by skiping it 
SkipToNextFile(Fl) ; 
dels++ ; 

} 

else 
{ 

if ((fwrite(&XTREMEJ3, 1, sizeof (XTREME_H) , F2)) 1= pizeof(X 
TREMEJH) ) return 1; 

if ((f write (PileN, 1, XTREMEJ5 . _NamLen , F2)) 1 = XTREME_H 

._NaraLen) return 1; 

c = ftell(Fl); 

for(;;) 

{ 

if ((k = getc(Fl)) == EOF) Error(9, // unexpected END 

-OP -Archive. . . 

putc(k, P2) ; 

if (C++ >= (headerjpos + sizeof (ARH_H) ) - 1) break; 
c = ftell(Fl); 

} 

} metnset(FileN, 0, MAX PATH) ; 

> ~~ ~~ 

sprintf (temp, » %d files will be replaced.", dels); 

Printf (temp, w \n", 2); 
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Fclose(Fl, 0, 0) ; Repack = 1; 
Freeze (files, 1); // repacking 
Fclose(Fl, 0,0); 
Fclose(F2, 0, 0); 

Printf ( n Deleting temporary files" , w 2); 

//if (dels) nu trebuie neaparat sa fie ceva de sters 

//GetCurDir (temp) ; 

// s treat (temp. Destination) ; 

GetCurDir ( temp ) ; 

v if (strstr (Destination, ":\\") == NULL) strcat (temp, Destination); 
-else strcpy (temp, Destination); " — 

_unlink (temp) ; 
rename (tempf ile, temp) ; 

return 0; // everything went okay I 

} 



/* 

Analyzing archive depth * 
Highest revision number Is 0 
Saving archive tags 
Creating empty target archive 

Updated archive is empty * 
Damage protecting archive 
Processing revision free files 
Analyzing 

Decompressing CHALES\LZCB_XXX\LZCB_XXX . NCB ERROR 90: file is damag 
ed ' 

Decompressing CHALBS\LZCB_XXX\RBSTBITS OK 
Decompressing CHALBS\RAX2\RAX2 ,MAK OK 
Decompressing CHALES\RAX2\DBFLA32.CP OK 
Decompressing CHALES\RAXX\RES\RAXX.RC2 OK 
Decompressing CHALES\RAXX\RES\lCONLIST.ICO OK 
Decompressing CHALES\RAXX\RES\IC0N4 . ICO OK 
Decompressing CHALES\RAXX\RES\ICON3 ♦ ICO OK 
Decompressing CHALES\RAXX\RES\ICON2.ICO OK 
Decompressing CBSUjBS\RAXX\RES\CTRLDEMO . ICO OK 
Decompressing CHALES\RAXX\RES\ICONl.ICO OK 
Decompressing CHALES\RAXX\RES\RAXXDOC.ICO OK 
Decompressing CHALES\RAXX\RES\RAXX.ICO OK 
Decompressing CHALES\RAXX\RES\RAXZ.GIF OK 
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Decompressing CHALBS\RAXX\RES\C0RS0R1.CDR OK 
Decompressing CHALES\RAXX\RES\MM1.AVI 14% 
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/****************************************************************** 
*********** 
* 

* 

* Dynamic Markov Encoding/Decoding procedures 
* 

* 

* 

* From Xtreme 106 (DLL) package by Sabin, Belu (c) 1999 
* 

* 

* 

* Fully 32 bit version ! 
* 

* Modified to "be used in the" XTREME project ! 
* 

* ( and OPTIMIZED as much as posible ) 
* 

* 

* 

********************************************************* 
***********/ 

#pragma pack (l) 

tinclude <io.h> 

#include <conio.h> 

#include <stdio.h> 

#include <string • h> 

#include <stdlib.h> 

^include <process . h> 

#include "markov.h 1 ' 
#include "util.h" 
#define MarKov 256 

long MaximumSize; // i need a signed here 

I 

short Current_JState=:0 ; 

struct Tree *STree [ MarKov ] ; 

unsigned char Bit[8] - {1,2,4,8,16,32,64,128}; 

unsigned char Pack = 0, Power = 0; 

short DeNode=l, c; 

long R=0, W=0, S=0, FSize; 

int LastCh; 
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void De_Init_Buf (void) 
{ 

struct Tree *Tmp; 

for (short y=0; y<MarKov; y++) { Tmp=STree[ y ]; free (Trap); 
} 

} 

void InitializeMarkovStates (void) 
{ unsigned short s; 

for(s=0; s < MarKov; S++) 

{ 

if ((STree[s] - (struct Tree *)malloc (sizeof (struct Tree)))==ND 
LL) abort (); 
} 

} 

void InitModel (void) 
{ unsigned short e, s; 

Pack = 0; Power = 0; W « 0; Cur r ent_S t a t e = 0; 

for( s=0; s < MarKov; s++) 
{ 

for ( e=2; e < 512/ e++) STree[s] ->Spl_Dad[e] = e » 1 ; 

for ( e=l; e < 256; e++) 

( 

STree[s]->Spl_St[e] => e+e; 

STree[s]->Spl_Dr[e] = STree[s] ->Spl_St [e] +1; 

} 

} 

} 

void SemiSplay (unsigned char C) 
{ short Dadl, Dad2, Aunt, Node; 

struct Tree *Tmp; 

Tmp=STree [Current_State] ; 

Node =* C + 256; 

do 

{ 

Dadl =» Tmp->Spl_Dad [ Node ]? 
if (Dadl 1= l ) 
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{ 

Dad2 = Tmp->Spl_Dad [ Dadl ] ; 
if (Dadl ==Trap->Spl_Br [ Dad2 ]) 
{ 

Aunt = Tmp->Spl_St t Dad2 ] ; 
Tmp->SplJSt [ Dad2 ] = Node; 

} 

else { 

Aunt » Tmp->SplJDr [ Dad2 ] ; 
Tmp->Spl_Dr [ Dad2 ] « Node; 

} 

if ( Node == Tmp->Spl_St I Dadl ] ) Trap->Spl_St [ Dadl ] = A 

unt; 

else Tmp->Spl_pr [ Dadl ] = A 

unt ; ' 

// Exchange Dads 

Trap->SplJDad [ Aunt ] = Dadl; 
Tmp->SplJDad [ Node ] = Dad2; 

Node = Dad2; 

} ; 

else Node = Dadl; 

} while( Node 1= 1 ) ; 

if (MarKov 1= 1) CurrentJState = C % MarKov; // MarKov Curre 

ntjState Change 

} 

/***************************************^************** ************* 
***************** 

These are Markov Encoding", and Decoding functions 
********** ******************************************************** 
*****************/ 

void MarkovEncode (unsigned int Size, unsigned char *Buffer, unsigne 
d char *0utBuff , unsigned int *outcnt) 
{. register short Nodel, Node2; 

unsigned char Stack [255], T=0; 

register struct Tree *Tmp; 

unsigned short s,e; 

unsigned char C; 
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Pack = 0; Power = 0; W = 0; Current_State « 0; 
for(s=0; s < MarKov; s++) 

Tmp=STree[s] ; 

for ( e=2; e < 512; e++). Tmp->SplJ>ad[e] = e » 1 - 

for ( e=l; e < 256; e++) 

{ 

Tmp->Spl_St [e] = e+e; 
Tmp->Spl_Dr[e] = Tmp->Spl_St [e]+l; 

} 

short Dadl, Dad2, Aunt, Node; 
for (unsigned int i=0; i<Size; i++) 
C = Buffer [i]; 

Trap = STree [Current_State] ; 

Nodel = C + 256; 

do 

{ 

Node2 = Tmp->Spl_Dad [ Nodel ] ; 

Stack [++T] = (Tmp->Spl_Dr [ Node2 ] Nodel) ; 

Nodel = Node2; 

}while (Nodel i = 1) ; 

do{ 

if (Stack [T--] ) Pack+=Bit [Power] ; 
if (++Power == 8) 

{ 

Power= 0; 

OutBuff[W++] = Pack; 
Pack=0; 

} 

} while (T >= 1 ) ; 

Node = C + 256; 
do 

{ 

Dadl « Tmp->SplJDad [ Node ] ; 
if (Dadl 1 ) 

{ 

Dad2 = Tmp->SplJ)ad [ Dadl ]; 
if (Dadl ==Tmp->Spl_Dr [ Dad2 ]) 
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} 

else 

{ 



Aunt = Tmp->Spl_st [ Dad2 ] ; 
Ttnp->Spl_st t Dad2 ] = Node; 



Aunt o Trap->Spl_Dr [ Dad2 ] ; 
j Tmp->Spl_Dr [ Dad2 ] = Node; 

if ( Node == Tmp->spl_st [ Dadl J ) Trap->Spl_st [ Dadl ] 

eXse ■ ■ 

Aunt; Tmp->s P l_Dr [ Dadl ] 



= Aunt; 



// Exchange Dads "** 

Tmp-:>SplJDad [ Aunt ] » Dadl; 
Tmp->Spl_Dad [ Node ] = Dad2; 

. Node = Dad2; 

} 

else Node = Dadl; 
} while ( Node != i ) ; i 
entltirSanie " CBM M t ^ t « = C % MarKOv, // MarKov ^ 

} 

if (Power) OutBuf f [W++] = p ac k; 
♦outcnt = W; 

} 

void MarkovDecode (unsigned int Size, unsigned char *Buffer unsicm* 
d char *OutBuff, unsigned int *outcnt) **"er, unsxgne 

unsigned short s,e; 
struct Tree *Tmp; 
unsigned char Ch; 

W = Current_State = 0; 
for{ s=0; s < MarKov; s++) 

Tmp=STree [s] ; 

for ( e=2; e < 512; e++) Tmp->Spl Dad[e] = e » 1 ; 
for ( e=l; e < 256; e++) 
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Tmp->Spl_St [ej = e+e; 
Tmp->spl_Dr[e] .= Tmp->spl_st [e]+i; 

} 



DeNode = 1; 



for (unsigned int i=o ; i<size; i++) 

Ch = Buffer [i] 

Trap=STree [Current_state] ; 

for (short w»0; w < 8; w++) 
if (DeNode >= 256) 

{ 

SemiSplay (DeNode-256) ; 
OutBuff [W++] = DeMode-256; 

r ^ // Get THE ROOT 

^ Tmp»STree[Current_State]; // on == Another == Tree 

Ch »= if 

} 

LastCh = Ch; 
*outcnt = W; 
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*********** ******************************** 



* 



Xtreme 106 DLL Main file / procedures 

* 

^ Fro* xtreme 106 (out,) package by sabln, Belu (e) 1999 



#pragma pack (1) 

#include <io.h> 
#include <conio.h> 
#include <stdio.h>. 
Sinclude <stdlib.h> 
#include <string.h> 
^include <memory.h> 
;#include <string.h> 

#include <dos.h> 
#i-nclude <direct.h> 

#include "util.h" 
#include B trees. h» 
#include ■ solid. h" 
#inqlude "markov.h" 
Singlude "deflate.h" 
#include B console.h n 
*#include "recover, h* 
#include "nonsolid.h" 

#inc*lude "exports. h* 
FILE *F1 / *F2 ; 

_declspec( dllexport ) void DeInit^Xtremel06_Engine (void) , 

Jpragma comment ( exestr, "Xtreme 106 DLL compiled bv q a Mn n ■, 

w _JDATE_ » at ■ TIME • ) compnea fcy Sabm Belu on 
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struct Shir *Sursa; 

char extractionDestination [_MAX_PATH1 ; 
char Destination [_MAX_PATH] ; 

ssjsttt * ° rTeate2 ■ scerg - ■ b ™" - °- »—* - 1. 

ng . ^ tmU — " »• "*«* - ?. ^rotejez = o, Repar = o. 2ip cioa*i 
Mut = 0, Incui =0; 

unsigned char *Fereastra = NULL; 
struct Newlnteger *prev = NULL; 

struct Newlnteger *head = NULL; ■- - 

unsigned char *l_buf = NULL; 
unsigned short *d_buf = NULL- 

unsigned char *BitBuf = NULL; unsigned int BitBufC; 
unsigned char *LenBuf = NULL; unsigned int LenBufC 

ZllZl* C J ar * L ^ tBuf = unsigned int LitBufC 

unsigned char *DistBuf = NULL; unsigned int DistBufC; 

ZSSS * Res tBuf2 = NULL; unsigned int RestBufC2; 

unsigned short *RestBufl = NULL; unsigned int RestBufCl,' 

unsigned int XXXInBufc, XXXOutBufC; 
unsigned char *XXXInBuf , *XXXOutBuf • 

char InFile [_MAX_PATH] ; 

long TotalRead, TotalWrit, TotalSum- 

char Tablelndex = 1, Solida = 0, 

av „ Recursiv = 0, AssuroeYes = 0/ archive type; 

extern struct TableData conf iguration_table7i5] ; 

int PreEmptivelnit (void) 

// very important ... . since we are doing a CRC on this structure 

meinset ( (unsigned char *)&ARH_ H , 0, sizeof (ARH H) } ; 
•return 0 ; — * 

} 



int PostBmptiyelnit(void) 

unsigned long MemUsed = 0, Meml, Mem2; 
unsigned char Uol[30] ; 
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ratio » 0; 

if (Fereastra == NULL) 

MeiaUsed+= 2L*WSI2B + 6*MTBUFJTOJtf^ ; 
♦ ^^'iaSS^nSS^^^ Newlnteger) *WSIZE 
024)JSo;, fioo^ 7 (1 ° 24 * 10 - 24 ^ • Mem2 = ((Messed - Men** (1024*! 
sprintf((char *)Uol, "%ld.*ld-, Meml, Mem2) , 

if (Repack == o) 
{ 

3, -^p; ?^ e3tin 9-; " 3, (char *)Uol, » 2 , „; • 

^ if(2ipCloaking, Printf(-. initializing Zip cloaking 

pu^tTn^r^ 81911 ^ char ' Fere — > > 

memory_request_alloc (struct Newlnteger , prev WSIZE) . 
} me m ory_re q uest_alloc (struct Newlnteger lEjE? sizB, ; 

memory.request.alloc (unsigned char, BitBuf, LITBUF_TO_ALLOC 

memory.request.allpc (unsigned char, LenBuf, I,ITBUF_ TO _ALLOC 

memory.reques^allcc (unsigned char, LitBuf, LITBUF.to.alloc / 

memory_request_alloc (unsigned char, DistBuf, LITBUF.TO.ALLOC 

me m ory_request_alloc (unsigned char, RestBuf2, LITB.UF_to_ A lloc ' 

men,ory_re q uest_alloc (unsigned short, RestBufl, LITBUF.TO.ALLOC 

memory^request.alloc (unsigned char, XXXInBuf, LITBUF__TO_ALLOC 

me ro ory_request_alloc (unsigned char, XXXOutBuf, LITBUF_TO_AIiLOC 

«f ll^T^JLlSn M ^ 11 head - ^ - 
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memset(Fereastra, 0/ 2L*WSIZE) ; 
return 0; 

} 

void DeInit_Xtremel06_Engine() 

memory_request_f ree (Pereastra) ; 
memory_reques t_f ree (prev) ; 
meraory_request_f ree (head) ; ' 
raemory_request_f ree (BitBuf ) ; 
raeinory_request_f ree (LenBuf ) ; 
roeinoryjrequest_f ree (LitBuf ) ; 
niemory_request_free (DistBuf ) ; 

memoryjrequeat^freetR^stBufi) ; ** -- ~- > - 

metnory_request_f ree (RestBuf 2) ; 

void Read j us tTables (void) 

WSIZE = configuration_table[TableIndex].WSIZB_INDSX* 0x800 

0; 

TOO DISTANT = conf igurationtable [Tablelndex] . TOO DISTANT*2 096 • 
:window_size = (ulg) 2*WSIZE; ~ 
;,MIN_MATCH = configurationtable [Tablelndex] .M1N MATCH-//3. 

MAX_MATCH = conf igurationtable [Tablelndex] .MAX~MATCh' ' 
;MIN_LOOKAHEAD = (MAX_MATCH+MIN_MATCH+1) ; 

JJASH_BITS = conf iguration_table [Tablelndex] . HASH BITS; 

BASH_SIZE o (unsigned) (1«HASH BITS) ; 

HASH_MASK = (HASH_SIZE-1) ; 

WMASK = (WSIZB-1); 

MAX_DIST = (WSIZE-MIN_LOOKAHEAD) ; 

H_SHIFT = ( (HASH_BITS+MIN_MATCH- 1 ) /MIN MATCH) ; 

D_REST_BITS = conf iguration_table [Tablelndex] .D REST BITS • 

PostEmptivelnitO ; - - 

int DeleteFiles (char *files) 
{ 

if (Read_Archive_Header(l)) { Error (1, »») ; exit(0); } 
af(Solida) return SolidDeleteFiles (files) ; 
else return DeleteNonSolidArchive (files) ; 

return -1; 

} 

void ListFrozenFiles (char *files) 
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{ 

if (Read_Archlve_Header(l)> { Brrord, »»),- exit(O)- \ 
if(Solida == o) NonSolidListFiles (files) ; 
else SolidListPiles (files) ; 



void DaraageProtectArchive(char archivetype, char forcejmode) 
if (Read_Archive_Header(0)) { Brrord, ""); return- } 

rcMve1?7 H *- reC ° Very - FileSiZe ?= ° 11 force - mode > iamageProtectorA 
else 

dy %)]'' RSCOVery fOUnd "' *= chiv * *■ 

yoid RemoveDamageProtection (char archivetype) 
if (ARHJBE._recovery_Pilesize) 

WipeCorrectionTables (PI) ; 
else 

{ ; * 

Error (14, » »);// » Recovery record not found !», "The archive 
must have been protected first ('protect command) !»),- 

} ;■• 

yoid ReAddProtectionO 

Pclose(Pl, o, 0); ; 
Pclose(F2, 0, .0); ; ; 

™® toda = ARH_H. ^recovery Method; 

COMPRBSS_RBCOVERY_RBCORD = ARH_H . _r e COvery~Compr e S S e d ; 

on" <(F1 = f °P en(Destination ' )) == NULL ) Error (0, Destinati 

PrintfC Readding data recovery records.", * ", 3) • 
DamageProtectArchive(archive_type, 1) ; 

yoid RepairDaraagedArchive (char archivetype) 

if (Read_Archive_fieader(0)) { Error (1, «•'); return; } 
if (ARH_H._recovery_Pilesize) 
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{ 

if((F2 * f open (■ repaired, xtr », »rb")) 1= NULL) 

char t = ScanForAcharf File repaired. xtr already exists^ O 
verwrite ? (Y)es, (B)nter/ {N)o/ (C)'ancel. . . », 4); 
switch(t) 

{ 

case ' Y 1 : case 'y» : case 'E 1 : case *e' : case 13 : p 
close (F2, 0, 0); goto Rep; break; 
} 

goto Afar; 

} 

Rep: if((P2 = fopen( "repaired. xtr", "wb+")) == NULL) return; 

RepairArchive () ; 
Afar:,- - 

} 

else 
{ 

Error (14, ■ ");// n Recovery record not found I", ■ The archive 
must have been protected first fp'rotect command) !"); 

} } 

void TryToRepairO 
{ 

if (ARH_H._recovery_Filesize o) return; 
Fclose(Fl, 0, 0); Fclose(F2 / 0, 0); 

if((Fl = f open (Destination, "rb+ w )) — NULL ) Error(0, Destin 
ation) ; 

Printf(» Trying to repair archive ...»,»», 3) ; 

PrintfC Creating repaired version, repaired. xtr », n n) ; 

RepairDamagedAr chive (archive_type) ; 



void LockArchiveO 
{ 

if ((fread(&ARHE, 1, sizeof (ARHJB) , Fl) ) sizeof (ARHJH) ) Err 

or(l, "•); // error openning archive 
ARH_H .^Locked = 1; 
, rewind (Fl) ; 

//if ((f write (&ARHJB, 1, sizeof (ARH_H) , Fl) ) != sizeof (ARH_H) ) E 
rror(7, »») ; // error writting the archive header 

if (FWrite_ARH_Header(SARH_H, Fl) ) Error(7, »»); // rewritten, ha 
s a 4 byte CRC built in ! 
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Printf (» Locked prefectly. ■ ; ". », 2); 

void PrintLOGOO 

Printf (» », "\n\n», 3) ; 

Printf (» XTREME DLL" , ■ », 16*0 + 10); 

Printf ("Ver 1.06 The UltiMate Data .Compression Tool. »\ n \ n » 

Printf(» ** THIS is a SHAREWARE Data Compression Program, written 
by Belu Sabin.", »\n», 7); , wriccen 

it^-Xn"**?" " ^ 3 REGISTBI ^ 6 P ro 9^ so, PLEASE, DO NOT use 
} P^SEi!-r-\S\n-^ eSS ^ ******* 6lSe ' «^ fc ' f « EVALUATION 

void PrintLogo(char action, char archive_type, char _updated_type) 

ndS^irStor,"; 178 ' 119 %S ^ SiZe -"' ^^-tion.table [Tablel 
Printf {tmp, »\n», 2); 

switch (action) 

-case 0 : sprintf (tmp2, » Creating%sarchive '%s>», archive type 
? - solid » : » », short_str (Destination, SO)); " ^ 

Printf(tmp2, n \n\n», 2); 
break; 

e "iTLJ^ ^printf (tmp2, - Bxtracting%sarchive .%s'», archive typ 
e ? solid « : .» », short_str (Destination, 50)); 
Printf(tmp2, "\n\n", 2) ; 
,"• break; 

- o a ?-„V s P rintf < tm P 2 ' " Testing%sarchive '%s'», archive type ? 
solid » : » », short_str (Destination, 50)); 
Printf (tmp2, »\n\n% 2) ; 
break; 

case 3 : sprintf (tmp2, • Listing%sarchive content '%s'», archiv 
e_type ? • solid » : » ». short_str (Destination, 50)); 
Printf (tmp2, "\n\n», 2) ; 
break; 
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case 4 : sprintf (tmp2, * Deleting frora%sarchive ^s IB f archive 
type ? ■ solid » : ■ », short_str (Destination, 50)); 
Print f (tmp2, »\n\n% 2); 
break; 

case 5 : sprintf (tmp2, ■ Updating%sarchive «%a ,B # archive type 
? n solid » : ■ », short_str (Destination, 50)); 
Printf (tmp2,»\n\n w , 2) ; 
break; 

case 6 t sprintf (tmp2, ■ Protecting%sarchive '%s,« (adding ecc) 0 
archive_type ? ■ solid ■ : ■ «, shbrt_str (Destination, 50)); 
Printf (trap2, "\n\n", 2) ; 
break; 

case 7 : sprintf (tmp2, w Removing protection from%sarchive *%a'* 
, archive_type ? ■ solid n : » », short_str (Destination, 50)); 
Printf (tmp2, »\n\n", 2) ; 
break; 

case 8 : 

sprintf (tmp2, ■ Repairing%sarchive »%s ,w f archive type 
? ■ solid " : » », shortest r (Destination, 50)); ~ 
Printf (tmp2 , » \n\n» , 20 ; 
break; 

case 9 : sprintf (tmp2, ■ Locking%sarchive ^s'", archive type ? 
» solid ■ : ■ «, short_str (Destination, 50)); 
Printf (tmp2, B \n\n B , 2); 
break; 

} ; 

} 



void CheckPorMove() 
{ 

int deleted_files = 0; 
char tmp [_MAX_PATH] ; 

if (Mut) 
{ 

Printf ( n Deleting freezed files'*, D n , 2); 
for (unsigned int i=0; i < SolidN; i++) 

Printf (" Deleted w », 3) ; 
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Printf (SolidArray[i] .RealName, »\n ■ 2)- 
iles ++ - ^^^^JP^fSolidArraylil.RealName, l) «'o) deleted_f 

}' 

sprintf(tmp, » %d moved to archive; % deleted files)- 
Printf (tinp, «\n«, i 0 ) ; - 

} 



void dll_main (void) 
{char rez = 0; 

ratio cs 0; 
SrintLOGOO ; ~ 
Print_Start() ; 
PreEmptivelnit ( ) ; 

// this line is more important then your life ! Chec it' 
^xfjsizeof (struct Newlnteger) I. 3) return; // you're doomed forev 

if (Listez) 

{ }; 

tion); fUF1 = fopen(Dest ^ atio *' "rb- )) == null ) Error(0, Destina; 

GetArchiveType ( &archive_type) ; 
Print Logo ( 3 , ar chi ve_type , 0 ) ; 
ListFrozenFiles (Sursa [0] .Name) ; 

else * 
if(Inghetz) 
{ 

n »ri" ( n X ~ S ST^ SfX " Z±pCl0akin9 II (F1 - *>pen(Destinatio 
{ 

stinationf;^ 2 " f °P en t Dest ^tion # "wh^ )) == null ) Error(0, De 

Actual izez = 0; 
PrintLogo(0, Solida, 0) ; 

if (Solida == 0) Freeze (Sursa [0] .Name, 0) , 
else SolidFreeze (Sursa [0] .Name) ; 

else 
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{ 

AssumeYes =1; 

GetArchiveType (&archive_type) ; 
Actualizez « Repack » 1; 
PrintLogo(5, archive_type , Solida) ,- 

//if (Actualizez » 1) PileSelectionO ; 
if (ARHJB .^Locked) Error (13 , n n ) ; 

if (archive_type == 1) rez = UpdateSolidArchive (Sursa [01 Na 
me, Solida) ; // to Solid, or to normal 

else rez = UpdateNonSolidArchive(S\irsa[01 

• Name, Solida); // Solida is from input, so what the users reouests ' 
for the next archive to be like I 

if (ARH^H.^recovery^Filesize && rez =~ 0) ReAddProtection() ; 
CheckForMove ( ) ; 

} 

else 

if (Testez | | Bxtrag) 

if( (Pl = f open (Destination, °rb» )) == NULL ) Error (0, Destin 
ation) ; 

GetArchiveType (&archive_type) ; 

PrintLogo(l+Testez, archive_type, 0) ; 

if(Extrag) MeltFileO; 

else 

{ 

rez = TestFrostedFiles () ; 

TestRecoveryRecordO ; 

if (rez > 7) TryToRepairO ; 

■'. L } 

else 

if (Sterg) 

Repack = 1; 
AssumeYes =1; 

if((Fl = f open (Destination, »rb» )) NULL ) Error (0, Destin 
atxon) ; 

GetArchiveType ( &archive_type ) ; 
Print Logo ( 4 , archi ve_type , 0 ) ; 

if (ARH_H._Locked) Error ( 13 , n n ) ; 

if (Sursa [0 J .Name) rez = DeleteFiles (Sursa [0] .Name) ; 
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if (ARH_H._recovery_Filesize '&& rez — o) ReAddProtectionO ; 

} 

else 

if (Protejez) 
{ 

if({Fl = f open (Destination, »xb+ n )) == NULL ) Error (0, Desti 
nation) ; 

GetArchiveType (&archive_type) ; 

PrintLogo(6 + (Protejez - : 1) , archive_type , 0) ; 

if (ARHJH .^Locked) Error (13, nn ); 

if (Protejez =» 1) DamageProtectiArchive (archive_type, 0); 
else RemoveDamageProt ect ion ( archive_type ) ; 

else 

if (Repar) 
{ 

if ({PI = f open (Destination, °rb+ 0 )) == NULL ) Error(0, Des 
tination) ; 

GetArchiveType ( &archive_type ) ; 
PrintLogo ( B , archive_type , Q ) ; 
RepairDamagedArchive (archive_type) ; 

else 

if (Incui) 
{ 

if ((PI = f open (Destination, n Th+" )) == NULL ) Error (0, Des 
tination) ; 

GetArchiveType (&archive_type) ; 
PrintLogo ( 9 , archive_type , 0 ) ; 
if (ARH_H._Locked) Error (13, ww ); 
LockAr chive { ) ; 

Fclose(Pl, 0, 0); 

Fclose(F2, 0, 0); •» 

if (MyXtrS tructure . EndDLLJob 1 » NULL) MyXtrStructure . EndDLLJob ( ) ; 



156 



WO 01/50612 



PCT/US01/00424 



InitDLL 



#pragma pack (1) 

#include <io.h> 
#include <conio.h> 
#include <stdio.h> 
#include <stdlib.h> 
#include <string.h> 
ftinclude <meraory.h> 
#include <string.h> 

#include <dos.h> 
#include <direct.h> 



#include "util.h" 

ftinclude n export s.h" 

extern void dlljmain(void) ; 

declspec ( dllexport ) void FreeOtherStuf f ( void) ; 

declspec ( dllexport ) int Init_Xtremel06JBngine ( XTREME106_CMDS 

TRUCTDRB *XtrStructure ) ; 

extern int PostEmptivelnitlnit (void) ; 
extern struct Shir *Sursa; 

extern char extractionDestination [_MAXJ?ATO1 ; 
extern unsigned char me to da, COMPRESS_RECOVERYJRECORD; 
extern char Destination [_MAX_PA'TH] ; 

extern char Inghetz, Testez, Sterg, Extrag, TestedOk, Listez, Act 
ualizez, Repack, Protejez, 

Repar, ZipCloaking, Mut, Incui; 
extern char Tablelndex, Solida, AssumeYes, Recursiv; 



XTREME1 0 6_CMDSTRUCTURE MyXt r Structure ; 

#def ine DLLInit Error (a , b, c , d) if (XtrStructure->ErrorMessageDi splay 
Function) XtrStructure->ErrorMessageDisplayFunction(a,b / c,d) ; 

void FreeOtherStuf f (void) 

{ 

free ((struct Shir *)Sursa); 

Fclose(Fl, 0, 0); // everything must be shut off whe 

n exiting 

Fclose(F2, 0, 0); // bugs disappear 

Fl = NULL; 
F2 = NULL; 
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} 

int Init_Xtremel06_Engine ( XTRBME1 0 6_CMDSTRUCTURE *XtrStructure ) 



Mut 




0; 


Incui 




0; 


Sterg 




0; 


Listez 




0; 


Repar 




0; 


Repack 




0; 


Testez 


= 


0; 


Extrag 




0; 


Inghetz 




0; 


TestedOk 




1; 


Protejez 




0; 


Actualizez 


= 


0; 


ZipCloaking 




0; 



raemcpy( (unsigned char *) &MyXtrStructure, 
(unsigned char *) &(*XtrStructure) , 

sizeof (XTREME1 0 6_CMDSTRUCTURE ) ) ; // why should we forget w 
onderful thing ? 

memset (Destination , o, _MAX_PATH) ; 

memset (extractionDestination, 0, _MAX_PATH) ; 



switch {Xtr Structure- >f unction) 



case 


XTREME_ADD 




Inghetz 


tSS 


If. 


break; 


case 


XTREMEJTEST 




Testez 




l; 


break; 


case 


XTREMB_MOVE 




Mut 




if 










Inghetz 




l; 


break; 


case 


XTREME_LIST 




Listez* 




l; 


break; 


case" 


" XTREMB_LOCK 




Incui 




l; 


break; 


case. 


XTREME_DELETE 




Sterg 




l; 


break; 


case 


XTREME_REPAIR 




Repar 




l; 


break; 


case 


XTREME__EXTRACT 




Extrag 




l; 


break; 


case 


XTREME__PROTBCT 




Protejez 




l; 





metoda = XtrStructure->protection met 

hod; 

C0MPRESS_RBCOVERY_RECORD - XtrStructu 
re r >compressn_ecc; // 0 . . 1 

break; 

case XTREME_DNPROTECT : Protejez = 2; break; 
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default : // there must be an error, undefined function called 

/* DLLInitError( n Wrong number in Xtreme function init ! », »\n 
",12, 

n None of these functions were supplied to me ... 

», n \n% 12, 

" XTREME_ADD, XTREME_TEST, XTREMEJ40VE, XT 

REME_LIST, % n \n», 12, 

■ XTREMB_LOCK, XTREMB_DELETE, XTREME_REPAIR , XT 
REME_EXTRACT, n , w \n B /l2 f 

9 XTREME_PROTBCT , XTREMB__UNPROTECT a / w \n a , 12 

■ Initialization error °, n °, .2, n n , " n , 2) 

; // so . . . 

*/ 

return 1; 
break; 

} 

// check the options ! 

Recursiv = XtrStructure->recursive; 

Tablelndex = XtrStructure->tablesize; 

Solida = XtrStructure->solid; 

ZipCloaking = XtrStructure->zipClo%king; 

if (Recursiv != 0 && Recursiv != 1). return 2; 
if (Solida != 0 && Solida » = 1) ; : return 3; 
if (Tablelndex > 8) , return 4; 

if (Tablelndex == 0) Tablelndex++; ' 

if (Protejez 1 && (metoda > 3 } j (COMPRESS_RECOVERY_RECORD != 0 
&& COMPRESS_RECOVERY_RECORD »= 1))) return 5; 

if {(Sursa = (struct ^hir *)mallqc (1xtrStructure->MaxDirectorie.s) * 
sizeof (struct Shir))) == NULL) return 7; // not enough memory! 

// if MaxDirectories field is specified, then take care, cause yo 
u have to suplly them, or else •[ 

for (unsigned int 1=0; i < XtrStructurd->MaxDirectories; i++) 

{ 

memset (Sursa[i] .Name, 0, MAX PAT 

H) ; \ ~ ~ 

memcpy(Sursa[i] .Name, XtrStructure->Sursele [i] .Name, MAX 

_PATH) ; 

} 

//if (XtrStructure->extractionDirectory [0] ) 

memcpy(extractionDestination, (char *j (XtrStructure 7 >extractionDi ■ 
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rectory) , _MAX_PATH) ; 

//if (XtrStructure- destination [0] ) 

memcpy (Destination, (char *) (XtrStructure- destination) , MAX PAT 
H) ; " ~ 

if (Sursa[0] .Name[0] == 0 && Destination [0] » 0) return 6; 

if(Extrag == 1 1 1 Sterg 1 /* is somewhere else, don't worr 
y | | Actualizez »= 1 I think there is room for Adaug and test */) 
FileSelection ( ) ; 

dll_main() j // and execute, too ! 

return 0; 

} 
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#define BITS 26 

#def ine MAXCHAR_CONTEXT 35 // MAXIMMUM CONTEXT CHAR NUMBER 

#define DOI_LA(n) (l«n) 

#define HALF DOI_LA(BITS - 2) 

#define FULL DOI_LA (BITS - 1) 

struct contextModel 

{ 

unsigned int Symbol sNo; 

unsigned int TotalFrequency; 

unsigned int Step; 

unsigned int MaximumFreq; 

unsigned int Freq [MAXCHAR_CONTEXT + 1]; 

}; 

struct Fill__In_Data 

{ 

unsigned int flag; 
unsigned int retValue; 

unsigned int thresholdValue; // please do not change the order o 

k 

unsigned int symbol sNumber ; 
unsigned int step; 

void ContextualEncodeBuffer (unsigned int read, unsigned char *Inbuf 
, unsigned char *Outbuf , unsigned int *out) ; 

void ContextualDecodeBuffer (unsigned int read, unsigned char *Inbuf 
, unsigned char *Outbuf , unsigned int *0utNo) ; 
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#define INIT_CRCVALUE Oxffffff ffL 
extern unsigned int crc_32_tab[] ; 

void upderc (unsigned char *s, unsigned int n, unsigned int *whatcrc 
); 

void local_short_crc (unsigned char *s, unsigned int n, unsigned sho 
rt *whatcrc) ; // 2 byte CRC derived from 4 byte CRC 
void local_uint_crc (unsigned char *s, unsigned int n, unsigned int 
*whatcrc) ; // 4 byte CRC 
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typedef unsigned char uch; 
typedef unsigned ush; 
typedef unsigned int : ulg; 

extern unsigned char *Fereastra; // SI 

iding window and suffix table (unlzw) 

extern struct Newlnteger *prev; // pr 

ef ix for even codes 

extern struct Newlnteger *head; // pr 

efix for odd codes 

//extern unsigned int *prev; // prefix 

for even codes 

//extern unsigned int *head; // prefix 

for odd codes 



extern unsigned int 
extern unsigned int 
extern unsigned int 
extern unsigned int 
extern unsigned int 



/ start of string to insert 



HASHJBITS; 
HASHJSIZE; 
HASHMASK; 
WMASK; 

window_size , string_starting ; 



extern unsigned int 
extern unsigned int 



MAX_DIST; 
HJ5HIFT; 



extern unsigned int MIN__MATCH; // 4,5 

extern unsigned int MAXJ4ATCH; // 258 

//258 // The minimum and maximum match lengths 
extern unsigned int MIN__LOOKAHEAD ; 

int inflate (); 

int deflate () ; 

void initialize^engine(shortr;^ 
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#include <conio.h> 

#def ine HELPCOL1 
#def ine HKLPCOL2 
#def ine HELPTEXT1 
#def ine HBLPTBXT2 
#def ine HBLPTKXT3 

#def ine VOLUME 

#def ine UNLINKING - 

#def ine REGI 

#def ine MENU_COLl 
#def ine MENU_C0L2 
#def ine MENU_SELECTED 
#def ine MENUJDISABLED 

#def ine COMMENT 
#def ine COMMENT_l 
#define COMMENT_2 
#def ine COMMENTARIU 

#def ine XTREMEJVERS ION 
#def ine LOG_FILE_NAME 

#def ine CHECKBOXCHAR 
#define CBOX_STR_COLOR 
#def ine CBOXCOLOR 
#define CBOX_COLOR 

#define RETRY_COD 
#def ine ABORTJZOD 
#def ine . IGNORE_COD 

#def ine .STORED 
#def ine STATIC 
#def ine DYNAMIC 

#def ine ADDING 
#def ine TESTING 
#def ine EXTRACT 

#ifdef " cplusplus 

#define CPPARGS ... 

#else ; #def ine CPPARGS 



16*8 + 11 

16*8 + 14 

16*8 + 14 

16*8 + 11 

16*8 + 15 

16*8 + 10 
1.6*8 + 11 

16*8 + 11 

16*7 + 11 - - 

16*7 + 0 

16*9 + 14 

16*7 + 15 

16*8 + 11 
16*8 + 11 
16*8 + 14 
16*8 + 15 

10 ' 

"klm^.log" 

"X 1 
16*7 + 15 
16*7 + 14 
16*7 + 11 

1 

2 

o" 
oxdo 

0x01 
0x02 

0x07 
0x08 
0x09 
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#endif 



#def ine ALT_MENU 
#def ine ALT_COLl 
#def ine ALT_COL2 
#def ine ARC_ALT_MENU 

#def ine ADD_COLl 
#def ine ADD_COL2 

#def ine SHORTCUT 
#def ine PAROL_COL 
#def ine RAM 
#def ine COPYR 
#define OSPATH 
#def ine FREBSPACB 

#define EDIT 
g : Volatile text 
#def ine WRITE 
s : UnVolatile 

#def ine PERCENT 
#define ADDPERCENT 
#def ine . TSTPERCENT 

#def ine ERROR_COLl 
#define ERROR_COL2 

#define PASSW_COLl 
#def ine PASSW_COL2 

#define INSERT_FOND 
#define INSERT_COLl 
#define INSERT_COL2 
#define INSERT_CHAR 

#define INSERT 
#def ine HOME 
#def ine DEL 
#def ine END 
#def ine TAB 
#define ST 
#define DR 
#def ine UP 



16*1 + 14 

16*1 + 11 

16*1 + 10 

16*1 + ' 2 

16*8 + 15 
16*8 + 14 



16*8 
16*8 
16*8 
16*8 
16*8 
16*8 



11 
14 
15 
14 
14 
15 



16*8 + 15 
16*8 + 14 



16*8 + 2 
16*8 + 14 
16*8 + 2 

16*RED ; + 15 
16*RED *+ 14 

16*RED + 15 
16*RED + 14 

16*8 +.2 
16*7 +15 
16*7 +-,14 
16*8 +14 . 

0x52 
0x47 
0x53 
0x4f 
0x09 
75 
0x4d 
6x48 



// Dialo 
// Color 
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#define DN 0x50 

#def ine NOSCROLL 2 

#def ine DOSCROLL 3 

#def ine NOINFO 0 

#def ine DOINPO 3 

#def ine CLOCK 1 

#define XCLOCK 73 

#def ine YCLOCK 1 
#define CLOCK_COLOR 16*8 + 11 

#define DOWN 20 

#def ine ATTRIBJZHAR 178 - ... // Oxfb 

#def ine MAXSCROLL_LEN 17 

#def ine INSERT_BUTTON 2 

#define ATTRIB_CHAR 178 // Oxfb 

#def ine MAXSCROLL_LEN 17. 

#define DOWN ~ 20 

#define JOS 1 

#define SUS 2 

#define MAX_MOUSE_SENSITIVE_TEXT 50 



#define ATTRIBCHAR 254 



#def ine NoTiceTime 






30 


#def ine DRIVE_NORMAL 


16*8 


+ 


11 


#def ine ADDCOL 


16*7 


+ 


14 


#def ine ADDFOND 


16*7 


+ 


15 


#def ine" "ARCHIVE * 


16*8 


+ 


11 


#define POND 


16*8 


+ 


15 


#def ine INFO 


16*8 


+ 


14 


#def ine TKXTINFO • 


16*8 


+ 


14 



#def ine SCROLL_ARROW 254 

#define SCROLL_FOND_CH 219 

#define SCROLL_KNOT_COL 16*8 + 13 

#define SCROLL_FOND_COL 16*8 + 7 

#define SCROLL_FONDJSELECTED 0 

#def ine SCROLI»_ARROW COL 16*8- + 15 



//Seconds 



// Name, Size, 
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#define FUNCTIONCOL 
#def ine STATUSBARCOLOR 

#define FILB_NORMAL 
r normal 

#define FILE_INSERTED 
r inserat 

#def ine PILE_NORMAL_SELECTED 
r normal • selectat 
#define FILB_INSERT_SELECTEI> 
r inserat selectat 

#def ine DIRECTORY_NORMAI* 

#def ine DIRECTORY__INSBRTED 

#def ine DIRBCTORY_NORMAL_SELECTED 

#def ine DIRECTORY_INSERT_SELECTED 

#def ine SENSITIVE_TEXT_NORMAL 
#def ine SENSITIVE_FDNCTIONS_NORMAL 
#def ine SENS I T I VB_TEXT_SBLECTED 

#define TGATE 

+ FAJSYSTBM+FA_ARCH 

#define vseg 0xb800 

Sdefine Year(ts) ( (unsigned 

//+1980 

Sdefihe Month (ts) ((unsigned 
/* 1..12 means Jan. .Dec */ 
#define Day(ts) ((unsigned 
/* 1..31 means 1st.. 31st */ 
#defirie Eour(ts) ( (unsigned 

#define Min(ts) ((unsigned 
#def ine Sec (ts) ' ( ( uns igned 

extern void ASTEAPTA (void) ; 



16*3 + 4 
16*3 + 8 

16*8 + 15 

16*8 + 14 

16*9 + 14 

16*9 + 3 



// Atribut Fisie 
// Atribut Fisie 
// Atribut Fisie 
// Atribut Fisie 



16*8 +11 
16*8 + 14 
•16*9 + 14 
16*9 +3 

16*7 + 0 
16*3 + 0 
16*3 + 14- 

FAJDIREC+FA_RDONLY+FA_HIDDEN 

int) ({ts >> 9) & 0x7f) + 80) 

int) (ts » 5) & OxOf) 

int) (ts » 0) & Oxlf) 

int)' (ts »~11) & Oxlf) 
int) (ts » 5) & 0x3f ) 
int) ((ts & Oxlf) * 2)) 
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#define 
#define 
#define 
Sdefine 
#define 
§def±ne 
ftdefine 
#define 
#define 
#define 



XTREME_ 

XTREME_ 

XTREME_ 

XTREME_ 

XTREME^ 

XTREME 

XTREME_ 

XTREME_ 

XTRKME_ 

XTREME 



ADD 

TEST 

MOVE 

LIST 

LOCK 

DELETE 

REPAIR 

EXTRACT 

PROTECT 

UNPROTECT 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 



struct PileName 

{ 

char *Name; 
char File ; 
char * PathlOr2; 
n an interface, here is its index 
char NotUsedl; // 4 
char NotUsed2; // 1 

}; 



// directory to add . . . 

// file or directory 

// since a path is required i 



typedef struct 

{ 

char solid; 
char function; 
char tablesize; 
char recursive ; 
char zipCloaking; 

char sfx; 

char compressn_ecc; 
char protect ionjnethod; 

char *Pathl; 
char *Path2; 

struct FileName Sursele [10000] ; 

char *Destination; 

char *extractionDirectory; 

unsigned int MaxDirectories; 



// ALL .those above I 



// 0 1 

// o .:; 3.- 

// files path 1 . 
// files path 2 . 



// archive name 

// extract to directory 



void (*EndDLLJob) 

int (*Utility_Function) 



(void) ; 
(char *mess r 



int 
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but_no) ; 

void (*ErrorMessageDisplayFunction) (char *messagel, char 

♦delimit 1, int colorl, 

char *message2, char 

*delimit2, int color2, 

char *message3 / char 

*delimit3, irit color3, 

char *raessage4, char 

*delirait4, int color4) ; 

void (*MinorStatusMessageDisplayFunction) (char *statusl, char 
*delimitl, int colorl);//, 

//char *status2,- ch 

ar *delimit2 f int color2) ; 

void (*MajorStatusMessageDisplayFunction) (char *statusl, char 
♦delimitl , int colorl , . 

char *status2 # char 

*delimit2 / int color2, 

char *status3, . char *delimit3, int color3, 

char *status4, char *delimit4, int color4, 

int procent) ; 

} XTREME 1 0 6__CMDSTRUCTURE ; 

extern XTREME1 0 6_CMD STRUCTURE MyXtrStructure; 
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#define MAX_CHARACTERS 256 

#define ROOTPLUSONE 511 

#define ROOT 510 

#define MAX_FREQ 0x8000 

#define MAX READ 0x32000 



struct HuffmanTree 

{ 

int Spl_Preq[512] ; 

int Spl_Dad [512 + 256]; 

int Spl_Son [512]; 

extern unsigned int outcount; 

extern unsigned char OutBuf [MAX_READ*2J ; // prevent expanding I 
// 

// EncodeBuffer (Size, Undefined, Undefined2, &X) ; 

// DecpdeBuffer (Size, Undefined, Undefined2, &Xk) ; < Size has t 

he same value 'here 

// Ex -> Encbde(66000, ) > 4000 ' just like 

at the encoding 

// Decode (66O00, .) - — > 66000 

void EncodeBuffer (unsigned int Size, unsigned char *Buffer, unsigne 
d char *0utBuf f , unsigned int *outcnt) ; 

void DecodeBuffer (unsigned int Size, unsigned char *Buffer, unsigne 
d char *OutBuf f , unsigned int *outcnt) ; 
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/* Common procedures and functions for both Encode and Decode */ 
struct Tree { 

short 
short 
short 
b 

void InitModel (void) ; 
void De_Init_Buf (void) ; 
void MPillName (unsigned char Chr) ; 

void InitializeMarkovStates (void) ; t 
void SemiSplay (unsigned char Ch) ; 
void BreakChars (unsigned char Ch) ; 

void MarkovBncode (unsigned int Size, unsigned char *Buffer, unsigne 
d char *OutBuff, unsigned int *outcnt) ; 

void MarkovDecode (unsigned int Size, unsigned char *Buffer, unsigne 
d char *OutBuff, unsigned int *outcnt) ; 



Spl_St [256] 
SplJDr [256] 
SplJDad[512] 
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extern unsigned long header_pos; // the main variable for 

// non-solid archives communicatio 

n 1 

int TestProstedFiles (void) ; 

int DeleteNonSolidArchive(char *files) ; 

int UpdateNonSolidArchive(char *files, char _to_what_type) ; 

int WriteJFake_Header{void) ; 
int Write_Real_Header(FILE*) ; 

void MeltFile (void) ; 

void NonSolidListFiles (char *f iles) ; 

void Freeze (char *FileMasfc, char repack); 

void PackFile(char *narae, unsigned int size); 
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#def ine NON_CONSECUTIVE_NO 
#def ine PROTECTED_BUPFERJNO 

// 5, 7, 11 ~ 

#define PROTECTED BUFFER SIZE 



11 // 3, 5, 7 

21 // the bigest values 

512 



struct DataRecovery 

{ 

unsigned short CRC; 

unsigned char buffer [PROTECTED_BUFFER_SIZB] ; 

h 

struct Protect 

{ - 

unsigned short n_subsector s ; 

unsigned int n_buffer_size; 

struct DataRecovery *recovery_ ;// [NON_CONSECUTIVE_NO] ; 

unsigned short *SubSectorCrc ;// [NON_CONSECOTIYE_NO * PR 

OTECTED_BUFFER_NO] ; 



struct Data 

unsigned short.; CRC; 

unsigned char .-" buffer [PROTECTED_BUFFER_SIZE] ; 

} ; 

struct ReadStructure 

struct Data Date [ PROTECTED_BUFFER_NO ] ; 

/ * 

extern unsigned char metoda, COMPRESS_RECOVERY_RECORD ; 

int CheckDataRecovery(FILE *FF) ; 

int WipeCorrectionTables(FILE *FF) ; 

int fteadProtectStructure (FILE *FF, char read); 

int WriteCorrectionTable(FILE *FF, char flush); 

int WriteProtect Structure (FILE *FF, char flush); 

int ReadCorrectionTable (FILE *FF, unsigned int FSize) ; 

int DaraageDetected (unsigned char *Table, unsigned int Sectorl, unsi 

gned int size, unsigned short *errorIndex) ; 

void Repair () ; 

void ComputeDataRecbveryRecord(FILE *FF) ; 
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void InitializeProtection (unsigned char met, unsigned int size, cha 
r protect) ? 

void Repair (unsigned char *Table, unsigned int bad_subsector, unsig • 
ned int TableSize) ; 

void Initial izeCorrectionForFile (FILE *FF, unsigned int size, char 
copy, unsigned char metode) ; 
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// { {NOJDEPENDENCIES} } 

// Microsoft Developer Studio generated include file. 

// Used by tester. rc 

// 



ftdefine 


IDD_TBSTER_DIALOG 


102 


#define 


IDR__MAINFRAME 


128 


#define 


IDC_STATIC002 


1000 


#define 


IDCJ3TATIC001 


1001 


#define 


IDC_STATIC003 


1002 


#define 


IDC_STATIC_004 


1003 


#define 


IDCJSTATICJ)05 


1004 


#define 


IDC_STATIC_100 


1005 


#define 


IDC_STATICJL01 


1006 


#define 


IDC_STATICJL02 


1007 


#define 


IDC_STATICJL03 


1008 


#define 


IDC_LIST1 


1009 


#define 


IDC LIST2 


1010 



// Next default values for new objects 
// 

#ifdef APSTUDIO_INVOKED 

#ifndef APSTUDIO_READONLY_SYMBOLS 

#def ine _APS_NEXT_RESOURCE_VALUB 

#def ine _APS_NEXT_COMMAND_VALUE 

#def ine _APS_NEXT_CONTROL_VALUE 

ftdefine _APS_NEXTJSYMED_VALUE 

#endif 

#endif 



129 
32771 
.1011 
101 
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Solid 



struct Solid_XTREMJB_Header 



{ 



unsigned long 


_TimeJDate; 


II 


8 


unsigned int 


_SizeUnCom; 


II 


4 


unsigned char 


NamLen ; 


II 


1 


unsigned char 


_Atrib; 


II 


1 


unsigned char 


JMOTJEJSED1; 


II 


1 


unsigned char 


_NOT_USED2; 


II 


1 


unsigned int 


_SolidCRC; 


II 


2. 



}; 



// Since opening a file does not mean actually that, we are going t 
o 

// preserve its full name in the .archive, then the easiest solution 
// will be to keep two names for the filej which is actually the si 
ngle 

// solution* 

// It is the best implementation for cases related the interfaces 

// where we are in a directory and we are adding sone files 

// there are not supposesd to be added with FullPath! 

struct SolidFileType • 

unsigned long time_date; 

unsigned int s size; 

char atrib; 

char - ■ selected; 

char ArchiveKeptName [JMAX_ PATH] ; 
char RealName [_MAX_PATH] ; 

char ' ext [ MAX EXT] ; 

h .; 

int Write_Solid_CSC (void) ; 
int Write_Solid_Header'(void) ; 
int . Read_Solid_Header ( void) ; . 

extern unsigned long TotalSolidSize; 
extern unsigned int SolidN, Solid_CRC; 
.extern struct SolidFileType *SolidArray; 

int SolidlnitO; 

int TestSolidArchive (void) ; 

int SolidDeletePilesCchar *) ; 
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int UpdateSolidArchive (char *files, char _to_solid_or_normal) ; 

int SolidMelt (void) ; 

void SolidBxtract (void) ; 

void Sol idFreeze (char *) ; 

int SolidListFiles (char *files) ; 

void UpdateSolidArray (unsigned int SolidKa) ; 

void SolidFillTheName (unsigned int, char *, unsigned int, unsigned 
long, unsigned char) ; 

» void SolidRePack (unsigned int no, char *fromWhere, char update) ; 



177 



WO 01/50612 



PCT/US01/00424 



#include <stdio.h> 

#define LITBUP 56*1024 

#define LITBUF_TO_ALLOC 64*1024 // prevent expanding 



/* 

Okay, please beware that these values are checked in case of test 
ing 

an archive ■stricata 1 ! So, within IK, the error must appear to be 
detectable 

So, remember that when you change these ones! 
V 

extern FILE *F1, *F2; 



// Bits 
// Literals 
// Lenghts 
// Distances 
// RestBuf2 

// One for all 



void TreejStart ( ) ; 

void Tree_Flush ( ) ; 

int. ReadJBlock ( ) ; 

void bits_f lush (void) ; 

int Tree_Bncode(int, int) ; 

void "send^bits (unsigned short value, short: length); 

void get_ bits (unsigned short *value, short length, bool ok); 

extern unsigned char restbits; 



struct Huf fJBlock 

{ 

unsigned char 
unsigned char 
unsigned char 
unsigned char 
unsigned char 
unsigned char 
unsigned int 
unsigned int 

}; 



_RestBits 
_Block_Type_0 
_Block_Type_l 
_J3lockJType_2 
_JBlock_Type_3 
_Block_Type_4 
_NOT_USED 
CRC total; 



5; 
lj 
1; 
1; 
1; 
1; 
6; 



extern unsigned char *BitBuf ; 

extern unsigned char *LenBuf ; 

extern unsigned char *LitBuf ; 

extern unsigned char *DistBuf ; 

extern unsigned char *RestBuf2; 
/ the compressible rest 

extern unsigned short *RestBufl; 



extern unsigned int BitBufC; 
extern unsigned int LenBufC; 
extern unsigned int LitBuf C; 
extern unsigned int DistBufC; 
extern unsigned int RestBufC2; 

extern unsigned int RestBufCl; 
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#include <io.h> 
# include <stdio.h> 
#include <stdlib.h> 

extern short ratio; 
extern char ZipCloaking; 

#ifndef CheckSl 

#define CheckSlash(t) if (t [strlen(t) - 1] 1= , \\« && t[0]) strc 
at(t, »\\»); 

#define CheckSl 
#endif 

struct TableData 

{ 

unsigned short. WSIZE_INDEX; . 
NDEX * 0x8000 

unsigned short MIN_MATCH; 
unsigned short MAX__MATCH; 

th 

unsigned short HASH_BITS; 
unsigned short TOO_DISTANT; 
ort ! 

unsigned short p_RBST_JBITS ; 
char Descriptor [50] ; 

b 



// Where WSIZE is WSIZE_I 

// The too far ! 

// The longest Match leng 

// The bits for hashing I 

// If it's too distant ab 



struct Newlnteger 

{ 

uns igned short . Li ; // the Ox AABB 

unsigned char He; // the 0x..CC 

}; 

struct HashNode - 

{ 

unsigned int _Info; // 4 

unsigned int NextLink; // 

}; 

7/ this structure was cloned in 1 export. h 1 

struct ARHJIeader // if you modify this, please update the export. h 
file, please 
{ 

char _Name[8]; // 8 = "ULEBloeXo 11 

unsigned int ^SolidN; // very good 

unsigned char Version,- // 



180 



WO 01/50612 PO7US01/00424 

ULil 



unsigned char 
unsigned char 
unsigned char 
unsigned char 
unsigned char 
unsigned int 
ection 

unsigned int 
unsigned int 

unsigned char 
unsigned char 
unsigned char 
unsigned char 



^Password; 
^Commented; 
_Locked ; 
_Vol; 

_HeaderCRC; 
_recovery_Filesize; 

_r ecovery_Me thod ; 
_recovery_Coinpressed ; 



_Not_Used 
jSolida 

_SolidaTableSize 
"NOT USED1 



2; 
2; 

8; 



unsigned int __UHeaderCRC ; 
e header reconessence ! 



}; 



struct XTREMB Header 



{ 



} 



short _Name : 3; // 101 

short _Flag : 3; 

short ^Directory : 2; 

short JTable : 5; 

short _NotUsed : 3 ; 

unsigned char _NamLen; 
unsigned char _HeaderCRC; 

unsigned short _Time ; 
unsigned short _Date; 
unsigned int * _SizeUnCom; 
unsigned int _NextFile; 
unsigned int _FileCRC; 



// 
// 
// 
// 
// 
// 



required by damage prot 



// One for all 



J I real 32bit CRC for th 



// 
// 

// 
// 
// 
// 
// 



struct Shir 
{ 

char Name [_MAX_PATH] ; 

} ; 

ftdefine PutC(Cod) {TotalWrit ++; putc(Cod, F2) ; } 

ftdefine SprintfBigNumber (sir,no) { if (no <= 999) sprintf (sir, 
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B %03d«, no%1000); \ 

else if (no < 

= 999999) sprintf (sir, n %03d,%03d n , (no/1000) %1000, 

no%1000); \ 

else 

sprintf(sir / n %d,%03d,%03d" , no/1000000, (no/1000) %l 
000, no%1000); } 

extern unsigned char *Fereastra; 

extern unsigned int TOCMDISTANT; 

extern unsigned int . WSIZE; 

extern unsigned short D_REST_BITS ; 

extern unsigned int XXXInBuf C, XXXOutBufC; 

extern unsigned char *XXXInBuf, *XXXOutBuf; 

extern struct ARH_Header ARH_H; 

extern struct XTREMB_Header XTREME_H; 

int Read_ZIP_ARH_Files() ; 
void Read__ZIP_ARHJieader() ; 



int FileSelection (void) ; 

void TryToRepair () ; 

void Get CurDir (char *temp) ; 

void Register_File_List (char *FileMask) ; 

void GetTeraporaryDirectory (char *buf f er) ; 

void Split (char *Name, char *drv, char *dir, char *fnam, char *ext) 

r 

void ComplexSplit(char *Name, char *drv, char *dir, char *fnam / cha 
r *ext) ; 



int Verify (char "*7 "char char/ char) ; 

int f ile_exists (char *disk, char *f ilename) ; 

int _unlinkjpath(char *path, char kill_directory) ; 

int Check_ARH_Header (struct ARH_Header *Ar) ; * 

int FWrite_ARH_Header (struct ARH_Header *Ar, FILE *F) ; . 

int CreateTeraporaryArchive (char *DestinationDir, char *terap_name) ; 

extern void GetArchiveType(char *archive_type) ; 
extern void window_f ill_in(void) ; 

extern void Error (short errorindex, char *additional_text) ; 

extern struct Shir *Sursa; 

extern char Destination [_MAX_PATH] ; 
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extern struct ARH_Header ARH_JH; 

extern void Pclose(FILB unsigned int, unsigned int) ; 

extern void PackPile (char *, unsigned int); . 

extern int OpenFile (char *, unsigned int, unsigned char); 

int Getc () ; 

int f lush_outbuf (void) ; 
int CheckStruct (char *P) ; 

int Write_Archive_Header (void) 

int writejbuf (char *buf, unsigned cnt) ; 

int Read_Archive_Header(char initialize_tables) ; 

int read_£rom_file (unsigned char *bu£, unsigned int size) ; 

short IntoarceProcent (unsigned long, unsigned long); 

unsigned int f readier c (unsigned char .unsigned int); 

char *short_str (char *, int); 

void Print_Start () ; 

void RepairArchive (void) ; 

void ReadjustTables (void) ; 

void SkipToNextFile(FILE *) ; 

void TestRecoveryRecord (void) ; 

void DamageProtectorArchive (void) ; 

void flush_window (unsigned int Cati) ; 

void InitFilesNameBuffer (unsigned char*, unsigned int); 

extern bool writejraelt; 

extern char InFile [_MAX_PATH] ; 

extern char trap [_MAX_PATH] , tmp2 [_MAX_PATH] ; 

extern unsigned irit afis_start; /* contor to count */ 

extern unsigned int count_ start; /* contor to print */ 

extern unsigned int SolidK, SolidN; 
extern long TotalRead, TotalWrit, TotalSum; 

extern FILE *F1, *F2; 

extern char Tablelndex, Solida, AssumeYes, Recursiv, TestedOk; 

extern unsigned int prev_length; 
extern unsigned int string_starting; 

extern unsigned int afis_start; /* contor to count */ 

extern unsigned int count_start; /* contor to print */ 

extern unsigned int match_start; 
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extern unsigned int injadvance_j:eading; 
extern unsigned short max_chain_ieiigth; 
extern unsigned short max_lazy_jmatch; 
extern unsigned short good_match; 
extern int nicejnaatch, BndOfPile; 

extern unsigned int hash_header; // hash index of string to be ins 
erted 

extern unsigned int MaxNodes, MAXNODES; 

extern char Inghetz, Testez, Sterg, Extrag, Repack, TestedOk, Liste 
z, Actualizez; Mut; 

#define memory_request_alloc (block_type, the_array r size_of_request 
) the_array - (block_type*) calloc ( (size_t) ( ( (size_of_request) +1L) / 
2) , 2*sizeof (block_type) ) ; 

#define memory_request_f ree (the_array) {if (the_array 1 = NUIjL) free 
(the_array) , the_arr ay=NULL ; } 

extern unsigned int TOO_DISTANT, WSIZE, window_size, HASH_BITS, HA 
SH_SIZB, HASH_MASK, WMASK, MAX_DIST, H_SHIFT, MIN__MATCH , MAX_MATCH, 

LJRBST_BITS , MIN_LOOKAHEAD; 
extern unsigned char HASH_MAX; 
extern char extractionDestination [_MAX_PATH] ; 
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//ZIPHEADS 



struct ZIP_Header 

{ 



unsigned int signature; 
ure 4 bytes (0x04034b50) 

unsigned short version; 
t 2 bytes 

unsigned short general_bit; 
2 bytes 

unsigned short compression_method; // 10 compression method 
2 bytes 



// 4 local file header signat 
// 6 version needed to extrac 
// 8 general purpose bit flag 



unsigned short tirae_; 

2 bytes 
unsigned short date_; 

2 bytes 
unsigned int crc32; 

4 bytes 
unsigned int compressed; 

4 bytes 

unsigned int uncompressed; 

4 bytes 
unsigned short filename! ; 

2 bytes 
unsigned short extra___len; 
2 bytes 



// 12 last mod file time 
// 14 last mod file date 
// 18 crc-32. 
// 22 compressed size 
// 26 uncompressed size 
// 28 filename length 
// 30 extra field length 



struct ZIP_Central_Directory_Header 
{ 

unsigned int signature; 
4 bytes (0x02014b50) 

unsigned short ver; 
2 bytes 

unsigned short ver_extr; 
2 bytes 

unsigned short general_bit; 
2 bytes 

unsigned short compress_m; 
2 bytes 

unsigned int tiiae_date; 
2 bytes unsigned short last mod file date 

unsigned int crc32; // crc-32 

4 bytes 

unsigned int compressed; // compressed size 



// central file header signature 
// version made by. 
// version needed to extract 
// general purpose bit flag 
// compression method 
// last mod file time 

2 bytes 
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4 bytes 

unsigned int uncompressed; // uncompressed- size 
4 bytes 

unsigned short file_n; // filename length 

2 bytes 

unsigned short extra_field; // extra field length 
2 bytes 

unsigned short f ile_comment; // file comment length 
2 bytes 

unsigned short diskjao; // disk number .start 

2 bytes 

unsigned short internal_attr; // internal file attributes 
2 bytes • 

unsigned int external_attr; // external file attributes 
4 bytes 

unsigned int relat_off set; // relative offset of local header 
4 bytes 
}; 

struct ZIP_EndjOf_Central_Directory_Header 

{ 

unsigned int signat_end; // end of central dir signatu 
re 4 bytes (0x06054b50) 

unsigned short this_id; // number of this disk 
2 bytes 

unsigned short alljao; // number of the disk with th 

e start of the central directory 2 bytes 

• unsigned short total_entries_here; // total number of entries in 

the central dir on this disk 2 bytes . 

unsigned short total_entries ; // total number of entries in 

. the central dir 2 bytes 
unsigned int size_of_cdh; "// size of the central direct 
dry 4 bytes " 

unsigned int start_cdh; // offset of start of central 

directory with respect to the starting disk number. 
4 bytes 

unsigned short comment_size; // zipfile comment length 
2 bytes 



size) 

}; 



// zipfile comment (variable 



extern ZIP_Header ZIP_H; 
extern zrP_Central_Directory_Header ZIP_CDH; 
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extern ZIP_End_Of__CentralJDirectory_Header ZIP_CDHEf 



int WriteFirstZipHeader (void) ; 

int WriteZipHeaders (long *AllWritten) ; 
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WHAT IS CLAIMED IS : 

1 . A method of compressing a plurality of files, said method comprising: 

examining said plurality of files to determine data characteristics that correspond to said plurality of 

files; 

determining ranking orders for said plurality of files according to said data characteristics; 
combining said plurality of files into a unified file at least according to said ranking orders; and 
compressing said unified file. 

2. The method of Claim 1, wherein compressing said unified file comprises compressing said unified file 
using a dictionary method. 

3. The method of Claim 1, wherein compressing said unified file comprises: 
compressing said unified file using a dictionary method to produce an output data file; and 
compressing said output data file. 

4. The method of Claim 1, wherein determining ranking orders comprises listing said plurality of files in a 
file order list. 

5. The method of Claim 1, wherein examining said plurality of files comprises examining file extensions of 
said plurality of files. 

6. The method of Claim 1, wherein examining said plurality of files comprises examining the file names of 
said plurality of files. 

7. The method of Claim 1, wherein examining said plurality of files comprises examining the file sizes of 
said plurality of files. 

8. The method of Claim 1, wherein examining said plurality of files comprises: 
determining whether at least one of said plurality of files includes predominantly text' 
determining whether at least one of said plurality of files includes predominantly numbers; 
determining whether at least one of said plurality of files includes predominantly image data; 
determining whether at least one of said plurality of files includes predominantly audio data; and 
determining whether at least one of said plurality of files includes predominantly video data. 

9. The method of Claim 1, wherein said compressing said unified file comprises: 
compressing said unified file to produce a output data file; and 

combining said output data file with one or more ZIP support portions to produce a ZIP-recognized 
output file, said ZIP support portions conforming to a ZIP file format. 

10. The method of Claim 2, wherein compressing said unified file further comprises using a dictionary that 
is larger than at least one of said plurality of files. 
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11. The method of Claim 2, wherein compressing said unified file further comprises using a dictionary that 
is larger than each of said plurality of files. 

12. The method of Claim 2, wherein compressing said unified file further comprises using a dictionary of a 
pre-determined dictionary size. 

5 1 3. The method of Claim 2, wherein compressing said unified file further comprises using a dictionary of a 

dynamically determined dictionary size. 

14. The method of Claim 2, wherein compressing said unified file further comprises using a dictionary that 
is larger than a dictionary size unit number. 

15. The method of Claim 3, wherein compressing said output data file further comprises compressing said 
1 0 output data file using a statistical method. 

1 6. The method of Claim 3, wherein compressing said output data file further comprises: 
separating said output data file into multiple sections; 

compressing said sections using at least one compression method to produce compressed results for 
said sections; and 

1 5 combining said compressed results into a final compressed result. 

1 7. A system for compressing a plurality of files, said system comprising: 

an examination module configured to examine said plurality of files to determine data characteristics 
that-correspond to said plurality of files; 

an ordering module configured to determine ranking orders for said plurality of files; . 
20 a combining module configured to combine said plurality of files as a unified file at least according to v 

the ranking orders of said plurality of files; and 

a compressing module configured to compress said unified file using a first compression method. 

18. The system of Claim 17, wherein said compressing module is further configured to produce an output 

data file. 

25 1 9. The method of Claim 1 7, wherein said first compression method is a dictionary method. 

20. The method of Claim 1 7, wherein said ordering module is further configured to list said plurality of files 
in a file order list. 

21. The system of Claim 18, wherein said compressing module is further configured to compress said 
output data file using a second compression method. 

30 22. The system of Claim 18; wherein said first compression method and said second compression method 

are different 
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23. The system of Claim 18, wherein said first compression method and said second compression method 
are the same. 

24. The system of Claim 18, wherein said compressing module is further configured to combine said output 
data file with one or more ZIP support portions to produce a ZIP-recognized output file, said ZIP support portions 

5 conforming to a ZIP file format. 

25. The system of Claim 19, wherein said compressing module is further configured to dynamically 
determine a dictionary size. 

26. A system for compressing a plurality of files, said system comprising: 

means for examining said plurality of files to determine data characteristics that correspond to said 
10 plurality of files; 

means for determining ranking orders for said plurality of files; 

means for combining said plurality of files as a unified file at least according to the ranking orders of 
said plurality of files; and 

means for compressing said unified file using a first compression method. 

15 
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